-- Logs begin at Thu 2022-05-12 15:47:43 UTC, end at Thu 2022-05-12 17:11:12 UTC. -- May 12 16:37:55.144881 dv-osbrick-836059-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 12 16:37:55.152271 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 16:37:55 2022] *** May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: nodename: dv-osbrick-836059-3-ceph May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: machine: x86_64 May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: clock source: unix May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: pcre jit disabled May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: detected number of CPU cores: 4 May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: current working directory: / May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: detected binary path: /usr/bin/uwsgi-core May 12 16:37:55.155363 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: your processes number limit is 47680 May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: your memory page size is 4096 bytes May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: detected max file descriptor number: 2048 May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: lock engine: pthread robust mutexes May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: thunder lock: enabled May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 16:37:55.155979 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 16:37:55.205170 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: Python main interpreter initialized at 0x564eca5f19c0 May 12 16:37:55.205170 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: python threads support enabled May 12 16:37:55.205170 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: your server socket listen backlog is limited to 100 connections May 12 16:37:55.205170 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: your mercy for graceful operations on workers is 90 seconds May 12 16:37:55.205544 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: mapped 403077 bytes (393 KB) for 2 cores May 12 16:37:55.205621 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: *** Operational MODE: preforking *** May 12 16:37:55.205869 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: *** uWSGI is running in multiple interpreter mode *** May 12 16:37:55.205869 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: spawned uWSGI master process (pid: 93651) May 12 16:37:55.206087 dv-osbrick-836059-3-ceph systemd[1]: Started Devstack devstack@keystone.service. May 12 16:37:55.207229 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: spawned uWSGI worker 1 (pid: 93661, cores: 1) May 12 16:37:55.207229 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: spawned uWSGI worker 2 (pid: 93662, cores: 1) May 12 16:37:55.207229 dv-osbrick-836059-3-ceph devstack@keystone.service[93651]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 16:38:01.120164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:38:01.120164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: from cryptography.utils import int_from_bytes May 12 16:38:01.121327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:38:01.121327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: from cryptography.utils import int_from_bytes May 12 16:38:01.124084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:38:01.124084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: from cryptography.utils import int_from_bytes May 12 16:38:01.124570 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:38:01.124570 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: from cryptography.utils import int_from_bytes May 12 16:38:01.172456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 16:38:01.172644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 16:38:01.173007 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] command line args: [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 16:38:01.173122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 16:38:01.173216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 16:38:01.173394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] command line args: [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 16:38:01.173603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 16:38:01.173818 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 16:38:01.173929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ================================================================================ {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 16:38:01.174175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] admin_token = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.174290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ================================================================================ {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 16:38:01.174659 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] admin_token = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.174772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] config_dir = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.174867 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] config_source = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175233 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] config_dir = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175335 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] debug = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175874 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] config_source = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.175942 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.176051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.176429 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.176805 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.176911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] debug = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177341 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.177876 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_config_append = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_dir = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_file = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.178910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179442 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179557 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_config_append = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.179840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180092 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_dir = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180584 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.180781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.181014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.181138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_file = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.181226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.181512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.181782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182028 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182100 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182527 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182698 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] publish_errors = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.182887 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183561 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183792 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.183902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184061 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184402 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] standard_threads = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.184927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185156 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] use_journal = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] use_json = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185632 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] use_stderr = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.185876 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] use_syslog = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.186055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.186151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.186450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.186575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.186843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.186930 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.187050 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] publish_errors = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.187164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.187388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.187642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.187861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.187965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.188124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.188322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.188412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.188514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.188624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.188829 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.189011 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.189098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.189261 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.189349 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.189523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] standard_threads = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.189622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.189798 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.189885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.190042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.190123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.190252 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.190439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.190527 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.190832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.191020 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] use_journal = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.191108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.191218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] use_json = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.191319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.191536 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.191618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] use_stderr = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.191788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.191896 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] use_syslog = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.192139 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:38:01.192407 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.192494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.192657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.192745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.192926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193029 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.193949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194748 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.194994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195237 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195499 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.195929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.196814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.197737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.197834 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.197905 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.197965 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.198058 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.200966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201074 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201157 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201472 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201828 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201828 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.201970 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202041 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202172 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202352 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202606 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202668 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202726 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.202973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203095 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203161 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203341 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203401 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203539 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203606 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.203978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204097 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204301 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204361 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204424 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.204863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.205444 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.205589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.205721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.205862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206843 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.206978 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207233 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.207890 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208823 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.208949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209679 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.209937 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210497 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210633 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.210956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.211989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.212215 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.213645 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.213790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.213921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214059 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214363 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.214622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.216896 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217693 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.217968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218105 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218285 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218551 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218551 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.218936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.external = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.219890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220434 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.password = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220692 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] auth.token = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.220965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221166 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221323 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221584 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221710 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.221965 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222247 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222667 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.222948 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223076 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.223855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224073 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224462 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224590 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.external = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.224908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.password = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.225965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226097 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] auth.token = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.226972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227242 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227501 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227758 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.227887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228327 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228637 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228637 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228897 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.228897 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.229980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230251 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.230940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231068 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231197 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231335 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231465 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231722 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.231984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232133 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232786 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.232923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233844 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.233844 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234094 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234094 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.234967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235607 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235753 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.235883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.236946 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237203 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237471 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.237878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238005 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238557 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238815 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.238949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239224 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239624 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239753 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.239881 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.240933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241200 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241723 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.241982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.242962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243093 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243361 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.243744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244308 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244828 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.244956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245551 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245751 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.245948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246273 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.246470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.250633 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.250755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.250839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.250913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.250985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251136 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251211 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251354 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251497 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.251722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252424 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252568 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252792 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252866 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.252938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253237 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253458 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.253967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254292 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254593 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254664 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254734 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.254963 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255180 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255321 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255401 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255546 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255757 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255829 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.255973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256115 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256185 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] role.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] role.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256600 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.256939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257159 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257726 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.257950 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258376 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258376 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258578 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258647 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.258938 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259079 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] role.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] role.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.259450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260339 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260462 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260646 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260743 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260875 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.260965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261038 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261180 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261403 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261685 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.261964 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262068 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262585 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262738 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.262949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263242 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263315 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263587 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263799 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.263948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264390 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.connection = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.264976 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265343 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265688 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.265980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266122 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266332 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266408 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.266994 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267287 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267358 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.connection = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.267989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.268340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.268464 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.268715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.268955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.269213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.269449 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.269691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.269929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:38:01.270107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 16:38:01.299506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.299749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.299956 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.300184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.300358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.300589 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.308976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.309357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.339267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.339496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.339661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.339894 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.398708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.399050 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.451869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.452095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.452721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.452962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.526913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527252 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527338 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.527865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.528007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.528102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.557955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.558183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.558439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.558668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.558924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.559867 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.560086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.560304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.572541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.573013 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.585785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.585979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.586954 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.587033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.587106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.587178 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.587329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:38:01.605700 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.605910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:38:01.606284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.606490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:38:01.606627 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.606764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.606864 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:38:01.607029 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.607171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.607286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.607367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:38:01.607540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.607629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.607880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.608142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.608398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.618604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.618905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.619239 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.619523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.619663 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.619948 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.620223 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.620511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.628328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.629222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.631704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.631983 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.632266 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.632552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.632635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.632837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.632920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633369 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633449 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.633995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.634171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.634311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.634464 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.634560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.634781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.635183 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.635463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.662476 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.662906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.664073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.664356 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.664531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.664815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.670467 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.670746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.670874 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.671142 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.671227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.671557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.678553 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.678836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.679235 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.679526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.683514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.683798 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684080 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.684381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.684950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.685147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.685246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.685414 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.685528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.685728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.686002 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.686303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.704601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.704876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.705445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.705725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.709480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.710441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.713884 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.714175 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.714703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.715000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.719375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.720202 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.723055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.723883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.726948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.727252 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.727538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.727669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.727825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.728014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.728108 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.728356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.729161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.729413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.729693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.748487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.748771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.749037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.749244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.749330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.749535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.749807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.750076 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.757550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.758378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.759299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.759650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.760138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.760485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.763149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.763435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.763746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.763842 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.764008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.764080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.764289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.764421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.764623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.764903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.778669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.778988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.779273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.779508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.779596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.779830 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.780102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.780235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.780412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.780544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.780734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.781055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.781470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.781765 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.799492 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.800730 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.802829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.804060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.806203 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.807927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.808130 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.809487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.809780 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.810065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.810374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.811175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.811456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.811761 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.817858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.819255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.819505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.820882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.822951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.823248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.824319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.824616 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.824810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.825112 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.826281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.826526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.834639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.834933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.835217 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.836088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.836383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.836673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.843809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.844088 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.844370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.844649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845268 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:38:01.845355 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.845923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846236 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.846986 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847409 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.847980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.848257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.848523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.848793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.849077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:38:01.886806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564eca5f19c0 pid: 93662 (default app) May 12 16:38:01.889327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564eca5f19c0 pid: 93661 (default app) May 12 16:38:01.890399 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7f87-fec9-40a4-b434-1d95f581356f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:01.890779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7f87-fec9-40a4-b434-1d95f581356f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:01.891069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7f87-fec9-40a4-b434-1d95f581356f None None] PATH_INFO: `/v3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:01.895290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Thu May 12 16:38:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:11.782479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:11.782996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:11.783077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:11.787348 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:11.792563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:11.792968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:11.793119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:11.823934 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG oslo_db.sqlalchemy.engines [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 16:38:12.011722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG passlib.handlers.bcrypt [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93662) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 16:38:12.012138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG passlib.handlers.bcrypt [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93662) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 16:38:12.069562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:12.071134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:12.203706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 12 16:38:12.357920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:12.392890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 16:38:12.521338 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37402d31-31a6-4563-9879-d397d63b7aa1 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:12.525795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:12.526483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:12.526773 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:12.527054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:12.535394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:12.587396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 16:38:12.588015 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58ac75-be64-4076-afaf-81578000680f admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:12.597840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Thu May 12 16:38:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 16:38:12.604323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:12.620131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d7f7-8c7f-4a3f-8e58-5fcf0c93d11b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:12.624550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:12.625680 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:12.625973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:12.626286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] PATH_INFO: `/v3/projects/117739cb2486406297165f39ae144b9a` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:12.636306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] RBAC: Authorizing `identity:get_project(project_id=117739cb2486406297165f39ae144b9a)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:12.687665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING keystone.common.rbac_enforcer.enforcer [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 16:38:12.688005 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704329ee-f7d0-4be0-aa3b-f2aa2d45defb admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:12.693925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Thu May 12 16:38:12 2022] GET /identity/v3/projects/117739cb2486406297165f39ae144b9a => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:14.978515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21d76-dfac-4793-b0f0-8ff5322728df None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:14.979032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21d76-dfac-4793-b0f0-8ff5322728df None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:14.979143 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21d76-dfac-4793-b0f0-8ff5322728df None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:14.983385 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:14.988935 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:14.989345 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:14.989497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:15.118704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:15.120757 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:15.132025 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 16:38:15.157056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21d76-dfac-4793-b0f0-8ff5322728df None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:15.170040 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21d76-dfac-4793-b0f0-8ff5322728df None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:15.174468 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:15.175099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:15.175381 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:15.175654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:15.184141 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:15.185913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e735-395a-4b05-b2ca-b2b733a5b695 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:15.194828 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Thu May 12 16:38:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 16:38:15.200925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:15.210271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8c7f4-ea81-416d-b523-9f210f6fd835 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:15.215356 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:15.216268 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:15.216517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:15.216787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:15.218174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:15.220018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d981e-2b7a-4e93-bf50-b0502ac2349a admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:15.222724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Thu May 12 16:38:15 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:17.595731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b677-4b8b-47f3-9d0e-654d428ebc71 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.596249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b677-4b8b-47f3-9d0e-654d428ebc71 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.596357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b677-4b8b-47f3-9d0e-654d428ebc71 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.597731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:17.603209 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.603624 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.603773 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.606330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355f34-76ce-42db-a945-0cc5f34efb06 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.606623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355f34-76ce-42db-a945-0cc5f34efb06 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.606904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355f34-76ce-42db-a945-0cc5f34efb06 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.609035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:17.614441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.614735 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.615018 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.622520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:17.623821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:17.656857 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG passlib.handlers.bcrypt [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93661) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 16:38:17.657281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG passlib.handlers.bcrypt [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93661) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 16:38:17.704761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:17.705244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:17.706969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:17.730339 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:17.807716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:17.830744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:17.832738 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7087d2-91ac-4f32-892a-c06c536e9f41 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:17.866241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408938d-e844-4212-97b8-890092d247ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:17.867005 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408938d-e844-4212-97b8-890092d247ca None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.867367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408938d-e844-4212-97b8-890092d247ca None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.867571 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408938d-e844-4212-97b8-890092d247ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.880240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408938d-e844-4212-97b8-890092d247ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-1408938d-e844-4212-97b8-890092d247ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:17.892328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:17.893241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:17.894459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:17.899396 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408938d-e844-4212-97b8-890092d247ca None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:17.930771 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc8d4-ff0a-4a63-b238-6bf7674af279 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:17.964796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294183b-032a-4408-aab0-09858128288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:17.965699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294183b-032a-4408-aab0-09858128288b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:17.965982 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294183b-032a-4408-aab0-09858128288b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:17.966293 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294183b-032a-4408-aab0-09858128288b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:17.996333 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408938d-e844-4212-97b8-890092d247ca None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.028811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.029485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.029771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.030051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.030843 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:18.031160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.032574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.035008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294183b-032a-4408-aab0-09858128288b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.036523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294183b-032a-4408-aab0-09858128288b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.045086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:18.050674 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:18.156506 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed090b-ce94-4fc2-964f-3401b403ea8e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.191390 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.192253 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.192534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.192809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.194079 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.195563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.197178 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 9/16] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:18 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:18.202826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:18.243749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 8/17] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:38:18.249394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294183b-032a-4408-aab0-09858128288b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:18.302066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe8c0-2f66-4df4-9597-6fa670298bbb None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.336570 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.338021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.338419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.338739 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.339906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.341375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.343026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:18.345914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294183b-032a-4408-aab0-09858128288b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.348737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:18.379860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.380647 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.380928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.381200 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.400280 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.401766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:38:18.422689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:18.423769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:18.424623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:38:18.424623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:38:18.424623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:38:18.424623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:18.424623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:18.429917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:18.446652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dd560-17e3-48b8-99a3-60c7d934a06a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.480065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.480740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.481013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.481292 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.482118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.domain.id=default, user.id=a20d203a05264464867ecc638e322e3e) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:18.482461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.483928 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4283f46-31bb-4357-95d5-399e1ff3b364 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.490692 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Thu May 12 16:38:18 2022] GET /identity/v3/role_assignments?user.id=a20d203a05264464867ecc638e322e3e&scope.domain.id=default&role.id=5067df1fd41e4852bda05f53294ab802 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:18.536907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7625a-d556-4c85-b913-4633b551edcc None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:18.574165 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:18.574873 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:18.575185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:18.575463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:18.576214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:18.576528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:18.578004 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4d91e-9b7e-48ce-bf71-2eaa74f8b1b6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:18.598003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:21.449325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dc0b0-3976-4284-88f0-f97d7fa60260 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.449849 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dc0b0-3976-4284-88f0-f97d7fa60260 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.449849 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2dc0b0-3976-4284-88f0-f97d7fa60260 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.451586 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:21.466238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.466738 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.466809 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.492698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:21.494836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:21.540882 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c306-4b04-4460-ba78-dae57de99942 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.542029 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c306-4b04-4460-ba78-dae57de99942 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.542519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c306-4b04-4460-ba78-dae57de99942 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.544376 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 13/23] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:21.549672 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb33466-2986-4efb-aefb-6cd1822fb9b3 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.550304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb33466-2986-4efb-aefb-6cd1822fb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.550829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb33466-2986-4efb-aefb-6cd1822fb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.579866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-1cb33466-2986-4efb-aefb-6cd1822fb9b3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:21.581502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-1cb33466-2986-4efb-aefb-6cd1822fb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:21.592217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:21.637795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:21.676361 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 14/25] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:21.678061 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8389-01a1-48cc-ab41-72fcbae7832e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.678647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8389-01a1-48cc-ab41-72fcbae7832e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.679236 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8389-01a1-48cc-ab41-72fcbae7832e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.682748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 15/26] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:21.688764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.689322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.689793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.718021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:21.719569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:21.777421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecc3a-2b87-44ae-9d51-56f60a299c44 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:21.828044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:21.828878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:21.829227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:21.829515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:21.831396 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 16/27] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:21.832551 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:21.845071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:21.853993 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:38:21.892630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:21.893448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:21.894267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:38:21.894267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:38:21.894267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:38:21.894267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:21.898330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 12/28] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:21.900555 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.054866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b333-3e92-4a78-b974-0d7a614b57f1 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.078295 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e516c-c83f-4b28-be64-78c50d8bc264 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.099935 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.100621 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.100955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.101231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.102030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.103609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.117910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.119808 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.127506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.127506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.133803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:22.145908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:22.147063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:22.147997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:22.149397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 13/29] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:22.150470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.268126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dda4c-ed10-4e0b-b466-0df7f58ef7f5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.304795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.305519 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.305889 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.306756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.310231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:22.310231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.310231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d908-07bc-445d-8394-e9ed838885e9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.321592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 14/30] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:22.322939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1d467-c4ad-40f3-aee5-fc1aa41f0d1d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.323289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1d467-c4ad-40f3-aee5-fc1aa41f0d1d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.323685 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1d467-c4ad-40f3-aee5-fc1aa41f0d1d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.329570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 15/31] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:22.330413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1d467-c4ad-40f3-aee5-fc1aa41f0d1d None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.367675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 17/32] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 12 16:38:21 2022] POST /identity/v3/roles => generated 219 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:22.369684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.459122 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1d467-c4ad-40f3-aee5-fc1aa41f0d1d None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.481140 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba129207-2316-4076-b02a-5658fb0f8106 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.497317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.498014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.498334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.498615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.499395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:22.499705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.501391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121fb6-b0e8-43ca-9055-206fb043be2a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.515273 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 16/33] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:22.516477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.516969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.517191 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.520303 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.521196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.521671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.522117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.523057 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.525479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.536760 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:22.537988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:22.630596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 17/34] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:22.631555 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.690472 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 18/35] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:38:22 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:22.691440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.755827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273b17a-e4de-4255-81a5-f83c7f471653 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.796057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.796974 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.797253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.797530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.799265 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.800969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.802927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 18/36] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:22 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:22.808471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:22.898071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4263b63-364d-4067-98b1-513deca65239 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.945196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8fa34-8e73-42db-a2df-5a54e5f2ee50 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:22.986410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.986410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.986410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.986410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.986869 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.987044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:22.987221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3ecd2-f022-4a5a-bf97-e9dd9a9184bd None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.987383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.987383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.987383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] PATH_INFO: `/v3/domains/default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.987802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:22.989773 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7bea-5670-4542-b966-9aeeec25aeec None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:22.992907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 19/37] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:22.992907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a719-0721-4451-b4cd-7fca622b591b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:22.992907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a719-0721-4451-b4cd-7fca622b591b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:22.993448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5a719-0721-4451-b4cd-7fca622b591b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:22.994627 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 20/38] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:22.998419 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5a719-0721-4451-b4cd-7fca622b591b None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:23.076449 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 12 16:38:22 2022] POST /identity/v3/roles => generated 225 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:23.077945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af789-8925-4c53-879a-b0bc6108666f None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.078281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af789-8925-4c53-879a-b0bc6108666f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.078568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963af789-8925-4c53-879a-b0bc6108666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.099004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-963af789-8925-4c53-879a-b0bc6108666f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:23.100680 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-963af789-8925-4c53-879a-b0bc6108666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:23.126109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5a719-0721-4451-b4cd-7fca622b591b None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:23.169446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:23.170390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.170779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.171108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] PATH_INFO: `/v3/domains/default/users/a20d203a05264464867ecc638e322e3e/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.173360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a20d203a05264464867ecc638e322e3e, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:23.175159 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26e86c-29aa-484e-b341-3a6caa7dbc3a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:23.185960 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 20/40] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:23.210271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af789-8925-4c53-879a-b0bc6108666f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:23.371310 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963af789-8925-4c53-879a-b0bc6108666f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:23.412543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:23.413536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.414008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.414524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.415642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:23.417364 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:23.425791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 21/41] 10.222.0.44 () {58 vars in 1361 bytes} [Thu May 12 16:38:22 2022] PUT /identity/v3/domains/default/users/a20d203a05264464867ecc638e322e3e/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:38:23.458817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b752-08f3-426e-b6ec-84217a8a4937 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.459119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b752-08f3-426e-b6ec-84217a8a4937 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.459407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b752-08f3-426e-b6ec-84217a8a4937 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.464105 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 22/42] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:23.470306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.470599 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.470868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.489607 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:23.491350 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:23.556531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 21/43] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 12 16:38:23 2022] POST /identity/v3/roles => generated 223 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:38:23.582392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 23/44] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:23.609450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:23.734216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f753b9-5e2d-41d7-af49-0b9d3606ef81 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:23.778222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:23.779033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.779324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.779602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.780797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:23.782370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb33f-1683-401b-b79b-89a3609181d6 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:23.784197 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 22/45] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:23.789646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:23.905176 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776aaa6-8b7e-44bd-aaec-8e535dcb96f3 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:23.940428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:23.941098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:23.941387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:23.941670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:23.942455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:23.944038 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59efa-8707-4d6d-8b17-1b1a6e15c2d0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:24.068210 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:38:23 2022] POST /identity/v3/projects => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:25.810374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770290-6aef-453d-8316-59e5694f130b None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:25.810978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770290-6aef-453d-8316-59e5694f130b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:25.810978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770290-6aef-453d-8316-59e5694f130b None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:25.812430 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 23/47] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:25.817746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:25.818166 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:25.818405 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:25.836213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:25.837737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:25.908404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 25/48] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:25.934770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770290-6aef-453d-8316-59e5694f130b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.034340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770290-6aef-453d-8316-59e5694f130b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.067517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.068229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.068515 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.068793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.079071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:26.086678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:26.087574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:26.088393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:26.089601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 24/49] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:26.093905 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.193825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f15cb-0171-492d-93ff-abf1e1d6e64f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.229951 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.230662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.231048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.231331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.232079 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:26.232383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.233806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc8f5-5ef1-4f8c-b0d5-e652af2be11b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.242000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 26/50] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:26.248149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.344776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b977-eba8-4f04-9779-3e56f7b60739 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.373734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8a5f-7780-44f1-9a29-2ca9d98851fc None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.374118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8a5f-7780-44f1-9a29-2ca9d98851fc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.374518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8a5f-7780-44f1-9a29-2ca9d98851fc None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.375935 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 27/51] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:26.378765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.379632 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.379911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.380184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.381358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.381465 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.381653 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.381976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.382849 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.389162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 25/52] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:26 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:26.390126 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.399185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:26.400486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:26.465397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 28/53] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:26.483456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba6ee7-b015-4781-9e00-ffe2d4d44821 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.489806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.519837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.520716 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.521176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.521522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.522863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.525039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.526806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 26/54] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:26.532443 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.586723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384b693-1402-4a2b-851b-c84202e4f8e3 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.619670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.620377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.620669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.620941 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.622118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.623628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.625244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 29/55] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:26.627990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e56b5b-6cd0-4202-98ce-aaccd580c315 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.630870 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:26.662218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.662913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.663187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.663473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.664307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.domain.id=default, user.id=a20d203a05264464867ecc638e322e3e) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:26.664618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.666793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9ca96-3802-47b8-802b-5d30717ce588 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.672652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 27/56] 10.222.0.44 () {56 vars in 1322 bytes} [Thu May 12 16:38:26 2022] GET /identity/v3/role_assignments?user.id=a20d203a05264464867ecc638e322e3e&scope.domain.id=default&role.id=5067df1fd41e4852bda05f53294ab802 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:26.734351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3dac1-c447-4b9a-8e4e-05710cf3fc61 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:26.770460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:26.771134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:26.771418 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:26.771699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:26.772413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:26.773886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f13749-6c9f-4933-9849-bcd3b74d4711 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:26.910427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 30/57] 10.222.0.44 () {60 vars in 1140 bytes} [Thu May 12 16:38:26 2022] POST /identity/v3/projects => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:38:29.252936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7cd6-9fcb-4cdc-88cf-e4b29513d81c None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:29.253531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7cd6-9fcb-4cdc-88cf-e4b29513d81c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:29.253531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7cd6-9fcb-4cdc-88cf-e4b29513d81c None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:29.254873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 28/58] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:29.260582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:29.260987 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:29.261134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:29.278285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:29.279483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:29.346530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 31/59] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:29.374050 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7cd6-9fcb-4cdc-88cf-e4b29513d81c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:29.471367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7cd6-9fcb-4cdc-88cf-e4b29513d81c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:29.503609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:29.504313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:29.504594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:29.504876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:29.506024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:29.507498 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b55251-d50b-4319-80e7-1bfc6ba4467f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:29.509652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 29/60] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:29.515373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:29.609275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e308-f533-495f-9de1-e0c5e75aec1f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:29.642264 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:29.642933 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:29.643224 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:29.643501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:29.644195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:29.645657 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ff392-5a6c-4d4d-a028-1d194a23fe49 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:29.758242 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 32/61] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:29 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:33.291444 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038db1-e52f-4cf8-8e57-8a89f410150d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.292495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038db1-e52f-4cf8-8e57-8a89f410150d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.293545 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038db1-e52f-4cf8-8e57-8a89f410150d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.295503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 30/62] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:33.300862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081475ef-c7af-4e93-9c20-b943b92bc16c None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.303965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081475ef-c7af-4e93-9c20-b943b92bc16c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.303965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081475ef-c7af-4e93-9c20-b943b92bc16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.327351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-081475ef-c7af-4e93-9c20-b943b92bc16c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:33.328957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-081475ef-c7af-4e93-9c20-b943b92bc16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:33.425061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 33/63] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:33.461829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038db1-e52f-4cf8-8e57-8a89f410150d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:33.559107 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a1f7-f031-46e5-8835-0859d5c4320f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.559728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a1f7-f031-46e5-8835-0859d5c4320f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.560249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a1f7-f031-46e5-8835-0859d5c4320f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.561860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 34/64] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:33.567499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64edd6b-6562-4b91-949b-3e5cc38c72a2 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.568106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64edd6b-6562-4b91-949b-3e5cc38c72a2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.568589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64edd6b-6562-4b91-949b-3e5cc38c72a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.594592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-c64edd6b-6562-4b91-949b-3e5cc38c72a2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:33.598440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c64edd6b-6562-4b91-949b-3e5cc38c72a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:33.612221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038db1-e52f-4cf8-8e57-8a89f410150d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:33.653869 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:33.654719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.655005 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.655278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.671152 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:33.680585 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:33.680858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:33.681705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:33.682510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 31/66] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:33.687856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:33.692184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298806-e547-4f2c-83eb-4e11423c8ae5 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.692719 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298806-e547-4f2c-83eb-4e11423c8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.693302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298806-e547-4f2c-83eb-4e11423c8ae5 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.694903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 36/67] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:33.703872 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.704442 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.704925 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.732260 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:33.733797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:33.807850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf1890-e8b2-47ff-be15-1cebadda6d85 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:33.818853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 37/68] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:33.818853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:33.851122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:33.851917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.852281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.852628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.853448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:33.853764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:33.855211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c281ac-15a9-447d-935e-45081a58f06d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:33.863996 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 32/69] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:33.865542 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bace-c614-4c80-b1db-b8e679da5be7 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.865987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bace-c614-4c80-b1db-b8e679da5be7 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.866289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bace-c614-4c80-b1db-b8e679da5be7 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.872319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 33/70] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:33.872319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bace-c614-4c80-b1db-b8e679da5be7 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:33.934867 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277be8b-6b3f-498b-b38b-6213135984b7 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:33.972418 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:33.972769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bace-c614-4c80-b1db-b8e679da5be7 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:33.973206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:33.973489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:33.973762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:33.984801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:33.992596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:33.993624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:33.994756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 38/71] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:33.995813 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.011524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.012340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.012628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.012910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.023154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-d40d579e-8ff7-4baa-8aa6-6e5a46caf4f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:34.031899 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:34.032958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 34/72] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:34.038995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a406-b181-4a71-a1d9-296888e4784d None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.039889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a406-b181-4a71-a1d9-296888e4784d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.039889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a406-b181-4a71-a1d9-296888e4784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.052954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5eb7a406-b181-4a71-a1d9-296888e4784d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:34.054158 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5eb7a406-b181-4a71-a1d9-296888e4784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:34.098621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dff88-4325-4721-b539-e9f3c68f3f97 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.120106 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 35/73] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:34.121268 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08e29-9539-4a9d-b5ed-ce84628868e3 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.121555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08e29-9539-4a9d-b5ed-ce84628868e3 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.121839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08e29-9539-4a9d-b5ed-ce84628868e3 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.123131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 36/74] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:34.123826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08e29-9539-4a9d-b5ed-ce84628868e3 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.133382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.134331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.134676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.135008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.151525 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.153577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.155336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 39/75] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:33 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.156124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.234962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08e29-9539-4a9d-b5ed-ce84628868e3 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.252917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb0e94-e07a-4feb-a55f-6177b89aa16a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.268883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.269546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.269827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.270102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.270862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:34.271164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.272620 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe83e-7172-46cf-b505-4dc1a64c153f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.281791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 37/76] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.282602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.283009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.283397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.286342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.287011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.287294 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.287575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.288329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:34.288637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.290027 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.298107 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 40/77] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.298947 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.299982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:34.301191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:34.365895 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:34.367053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.397154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4c75-240c-46ad-807b-f85a4e823d20 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.430776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.431574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.431858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.433570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.435066 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.436866 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 41/79] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.437557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.470231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b0cb-a41e-49bf-bcec-74294379a7d1 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.502831 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.503478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.503761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.504039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.535036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aece2d-20c5-4f69-88ce-8f0de2627965 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.568139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.568719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.569010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.569293 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.569572 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.570223 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.570847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.572261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.574600 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 42/80] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.575338 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.664154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 39/81] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:34.665012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.671778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf4515-d11f-4b0b-a64f-663cb43d34c5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.705464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.706368 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.706653 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.706934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.708136 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.709580 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.711455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 43/82] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:34.712001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.767812 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3271-6d42-4cec-a336-236cf605d9ce None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.800629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.801424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.801709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.801988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.808533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62e81-13b1-46fe-8a74-b2cdc6301bd0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.812500 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:34.820116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:34.821037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:34.821802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 40/83] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:34.822502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.843259 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.843930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.844214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.844493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:34.845199 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:34.846693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:34.921037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446465-5ff9-42fa-a89f-b8cb98468dcf None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:34.934700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 44/84] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:34 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:34.946449 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:34.959990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:34.960660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:34.960949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:34.961238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.040731 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.042867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.055029 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96c8-7c83-462a-8bcf-e6fa3292461e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.093769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.094680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.094967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.095254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.096479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.097971 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.099794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 45/85] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.099794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.150113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 41/86] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:35.151064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.208063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf9701-1db6-4eea-a454-6f877052ec83 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.244197 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.244918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.245201 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.246044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.270870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7030-dffd-4fc7-93cc-f2c3f61a4910 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.307720 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.309061 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.309306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.309575 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.311144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:35.311144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.312098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.322015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 42/87] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.323034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.332434 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.333925 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.431922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00921-3eca-4990-8fee-0b3d507509a3 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.463864 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 46/88] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:35.465410 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.473687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.474617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.474908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.475191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.476033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:35.476346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.477816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.484720 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 43/89] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.485550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.591638 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d41cc-c5e4-4b2d-bcb2-7c746c189f34 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.606515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fa34f-0b1b-4408-82be-cd933272063a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.626262 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.627157 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.627706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.627986 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.629288 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.630850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.632776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 44/90] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.633490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.651216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.652972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.653349 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.653631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.655006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.656656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.658501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 47/91] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.659328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.749252 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153f502-b4d2-4fc3-939f-11178070f708 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.779815 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.780691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.780976 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.781261 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.782523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.784003 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.788653 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57314699-c5c4-4342-9df9-5c4202328f54 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.790325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 45/92] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.791322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:35.826794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.827522 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.827810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.828147 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.903443 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.904165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a923-25b2-4ca2-b26e-9f94d7d62073 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:35.904953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.939530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:35.940433 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:35.940862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:35.941281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:35.942301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=a20d203a05264464867ecc638e322e3e) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:35.942770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:35.944369 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:35.950634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 46/93] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/role_assignments?user.id=a20d203a05264464867ecc638e322e3e&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=5067df1fd41e4852bda05f53294ab802 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:35.951646 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:36.055899 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 48/94] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:36.061493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:36.119373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68f38a-1d82-4e12-8c4d-2a69d4fa1476 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:36.177378 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:36.178307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:36.178765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:36.179179 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:36.180164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] RBAC: Adding query filter params (role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:36.180635 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:36.183086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:36.196567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 47/95] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:35 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:36.206087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01a404-1d01-4fa9-8724-7127b0eec684 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:36.246220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:36.247106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:36.247458 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:36.247736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] PATH_INFO: `/v3/projects/5f5b773cfbf641739a4d340e34e0b699` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:36.249045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5b773cfbf641739a4d340e34e0b699)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:36.250549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfbefb-953b-4015-9017-889dad68ffb0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:36.252859 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 49/96] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:36 2022] GET /identity/v3/projects/5f5b773cfbf641739a4d340e34e0b699 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:36.258569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:36.394294 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86e03e-7d98-488f-b82e-c1550cd8a967 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:36.436541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:36.437599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:36.438113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:36.438639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:36.439677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=5f5b773cfbf641739a4d340e34e0b699, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:36.440190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:36.442122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9ef60-eb39-4c03-948e-dd87504c8fac None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:36.448931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 48/97] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:36 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=5f5b773cfbf641739a4d340e34e0b699&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:38.423702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf899-36b0-461e-b4d5-71ffb424c51b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.424240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf899-36b0-461e-b4d5-71ffb424c51b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.424240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf899-36b0-461e-b4d5-71ffb424c51b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.426039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 50/98] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:38.431705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.432183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.432256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.451362 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:38.452572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:38.484699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678aee0-6b2a-444b-8d6d-d0e590796de4 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.485104 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678aee0-6b2a-444b-8d6d-d0e590796de4 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.485261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678aee0-6b2a-444b-8d6d-d0e590796de4 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.487145 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 51/99] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:38.496070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.496335 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.496619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.529212 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 49/100] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:38.535359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:38.536576 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:38.549373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:38.627826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 52/101] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:38.651767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:38.753912 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268611-07f9-41a9-a49d-880dffef32a2 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:38.760790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06a7f3-fbac-47e7-8e8f-2dc979fe7578 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:38.788051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:38.788848 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.789132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.789407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.801369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:38.809856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:38.810839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:38.811841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 53/102] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:38.817608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:38.835603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:38.837474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.838120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.838948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.847152 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:38.849760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:38.853247 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 50/103] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:38.860586 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:38.936961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ceb0-36fb-4f73-ac1c-5ad31263c136 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:38.970266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:38.970945 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:38.971228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:38.971504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:38.972254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:38.978565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:38.978565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:38.992772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 54/104] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:38.999573 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:39.100844 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16940980-7e77-4b93-b385-9fd2d09d2965 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:39.181602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:39.182374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.182671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.183070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.184151 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:39.186893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9d24-74b1-49ba-ac29-8be309a1270f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:39.246940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984413-2c1d-41dc-ab68-e8137311304e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:39.296928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:39.297791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.298080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.298396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] PATH_INFO: `/v3/users/e52b3f24e6b34799a0f486748ac41e63` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.314943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] RBAC: Authorizing `identity:get_user(user_id=e52b3f24e6b34799a0f486748ac41e63)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:39.316444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db2469-ae96-4914-9b69-fa5948f5b997 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:39.319169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 55/105] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:38 2022] GET /identity/v3/users/e52b3f24e6b34799a0f486748ac41e63 => generated 289 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:39.324464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544733ce-88df-4cdd-8ba0-7769f0621370 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.325103 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544733ce-88df-4cdd-8ba0-7769f0621370 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.325446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544733ce-88df-4cdd-8ba0-7769f0621370 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.327554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 56/106] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:39.328408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544733ce-88df-4cdd-8ba0-7769f0621370 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:39.367478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 51/107] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:38:38 2022] POST /identity/v3/projects => generated 302 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:39.370438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.372999 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.373520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.434642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:39.438620 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:39.556230 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 52/108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:39.598277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544733ce-88df-4cdd-8ba0-7769f0621370 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:39.609511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:39.665566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:39.666369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.666656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.666936 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.782908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:39.785386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed01d8-5fca-4bb2-9f67-11fe9153df61 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:39.790147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1886fb-34f0-4c62-8872-3639d2b6921b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:39.851967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:39.853609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.854333 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.854948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.877818 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-01d30abd-5b81-4160-8727-716c8fc5cab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:39.895702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:39.899898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 53/109] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:39.900988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271083ab-02c7-4aea-8b74-eb5e03d9aae7 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.901759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271083ab-02c7-4aea-8b74-eb5e03d9aae7 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.901759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271083ab-02c7-4aea-8b74-eb5e03d9aae7 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.905518 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 54/110] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:39.910403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271083ab-02c7-4aea-8b74-eb5e03d9aae7 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:39.957295 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 57/111] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:39.963344 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:39.965838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:39.967688 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:39.999729 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:40.002302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:40.101266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 58/112] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:40.107180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.112514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271083ab-02c7-4aea-8b74-eb5e03d9aae7 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.158493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.159218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.159505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.159839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.160583 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:40.160937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.163074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddfa3e-b870-4b6a-b51e-6b1247f14604 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.171761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 55/113] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.173111 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0139-229e-4e4b-a755-7b2cfc8b4508 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.173407 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0139-229e-4e4b-a755-7b2cfc8b4508 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.173850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0139-229e-4e4b-a755-7b2cfc8b4508 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.174911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 56/114] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:40.175663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0139-229e-4e4b-a755-7b2cfc8b4508 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.242309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974b862-c820-4c01-a566-ef3a1db1aef8 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.280559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.281417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.281700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.281984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.283220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.284670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.291083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 59/115] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.291083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.292894 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0139-229e-4e4b-a755-7b2cfc8b4508 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.329567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.330469 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.330751 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.331029 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.342932 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ef987f1a-b954-4a65-902b-3a7fe9b7055e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:40.350923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:40.351746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:40.352496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 57/116] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:40.353527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.353823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.354099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.372475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:40.373663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:40.401329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a57d-6cc8-419c-bcb9-6302b567d54f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.436613 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.437509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.437795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.438080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.439412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.443464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b97f08-f992-429c-a1df-7946c26eab1d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.443464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 60/117] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.443797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356c5f-6f07-4f78-8533-9a1357f7421a None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.444088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356c5f-6f07-4f78-8533-9a1357f7421a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.444369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356c5f-6f07-4f78-8533-9a1357f7421a None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.444534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 58/118] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:40.445740 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 61/119] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:40.446147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.456586 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356c5f-6f07-4f78-8533-9a1357f7421a None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.559200 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55728-d4da-4a6e-ac2a-ea936669520f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.560909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356c5f-6f07-4f78-8533-9a1357f7421a None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.594855 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.595054 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.595528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.595714 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.595819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.595991 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.596080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.596233 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.596807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:40.597060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=e52b3f24e6b34799a0f486748ac41e63) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:40.597153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.597373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.598513 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf291b-095e-4cf7-b3ca-2905435ee6c9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.598929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.614624 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 59/120] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/role_assignments?user.id=e52b3f24e6b34799a0f486748ac41e63&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.614624 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.618084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 62/121] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.623087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.623087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.623087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.643396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:40.645228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:40.738469 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60105426-9668-44e8-afd6-f92a2f3508c8 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.740285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 63/122] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:40.743134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.802977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.804735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.804735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.804974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.806656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.808903 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.811434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 60/123] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.811719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.880868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff636-8647-4f4e-936e-af18697a9788 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.922946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.924076 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.924541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.925100 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.936373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:40.937738 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce27ca-9698-4317-86da-13c5be4e4b9a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:40.944871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:40.945778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:40.946564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:40.949745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 64/124] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:40.950914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:40.982857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:40.984572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:40.985343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:40.985850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:40.988165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:40.990045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:40.993239 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 61/125] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:40.994456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.063578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffff00-86aa-4894-8616-17506d5ac616 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.108202 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.109477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.110104 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.110689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.116114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7312ab-c39c-4fd9-ba7f-34a427ae0324 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.125395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:41.138084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:41.138999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:41.139768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:41.142467 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 65/126] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:41.144086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.156055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.157305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.157305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.157554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/a20d203a05264464867ecc638e322e3e/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.159709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, user_id=a20d203a05264464867ecc638e322e3e, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.161263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.238287 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 62/127] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:40 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/a20d203a05264464867ecc638e322e3e/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:41.248196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.266238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72757-b655-4d9a-abed-91508ec0c8ed None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.326538 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.327210 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.327495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.327775 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.330471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:41.330802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.332266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.355716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 66/128] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:41.358823 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.467317 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ae51-fd7e-4f34-a991-8f9e66bffa01 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.515173 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.516111 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.516866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.516866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.517918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.519441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.521784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 63/129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:41.522488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.538179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147dac1-2f8c-4fdb-bb7a-af3aa1a962a8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.573591 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.574739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.575252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.575730 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.576738 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:41.577249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.578879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.587853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 67/130] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:41.588930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.636890 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3653bf-b263-456e-b14a-298c7c36e3c1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.678685 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.683907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.683907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.684120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.686924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.690521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.692360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 64/131] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:41.694696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:41.793445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eccc23-97c6-4338-90ee-4fe17b848ed9 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.860391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.861213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.861497 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.861788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/40d2b8384f224aedb6470ca4777a83ab/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.864559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, user_id=40d2b8384f224aedb6470ca4777a83ab, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.866081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.887600 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb614-f8b9-4758-8d8e-180a67cdcbcc None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:41.924967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:41.926183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:41.926719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:41.927180 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:41.928783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:41.930737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:41.932942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 65/132] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:41.933973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:42.009296 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 68/133] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:41 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/40d2b8384f224aedb6470ca4777a83ab/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:42.010446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:42.115019 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819be9c-6172-4795-a274-9bd9840ee8f7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:42.161599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:42.162583 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.162917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.163207 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] PATH_INFO: `/v3/projects/5f5b773cfbf641739a4d340e34e0b699` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.164475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5b773cfbf641739a4d340e34e0b699)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:42.165980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca273d-93d9-4b87-a90c-dfd954022067 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:42.170241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 66/134] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:41 2022] GET /identity/v3/projects/5f5b773cfbf641739a4d340e34e0b699 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:42.170241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9eb9-d318-43ea-850a-b53d94a66825 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.170494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9eb9-d318-43ea-850a-b53d94a66825 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.170722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c9eb9-d318-43ea-850a-b53d94a66825 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.172123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 67/135] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:42.178474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.179169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.179463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.200753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:42.202521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:42.228754 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf29fa-7a75-45b2-9858-fb07bfad8347 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:42.298310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:42.299583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.300141 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.300429 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.302607 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:42.304389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:42.306124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 69/136] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:42 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:42.307586 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:42.324401 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 68/137] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:42.325262 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:42.478060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616998ce-b860-4fcf-8549-fb586c2ef485 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:42.490917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351847a-5851-40fb-a3ac-24b34a3c0d4a None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:42.525772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:42.527331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.527620 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.527903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] PATH_INFO: `/v3/projects/5f5b773cfbf641739a4d340e34e0b699/users/40d2b8384f224aedb6470ca4777a83ab/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.533769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5b773cfbf641739a4d340e34e0b699, user_id=40d2b8384f224aedb6470ca4777a83ab, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:42.536327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:42.541153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:42.542668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.543053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.543348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/40d2b8384f224aedb6470ca4777a83ab/roles/c0065defbccb49c69fbc0e7b8de85e36` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.550960 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, user_id=40d2b8384f224aedb6470ca4777a83ab, role_id=c0065defbccb49c69fbc0e7b8de85e36)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:42.552535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:42.650067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 70/138] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:42 2022] PUT /identity/v3/projects/5f5b773cfbf641739a4d340e34e0b699/users/40d2b8384f224aedb6470ca4777a83ab/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:42.651331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:42.688767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 69/139] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:42 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/40d2b8384f224aedb6470ca4777a83ab/roles/c0065defbccb49c69fbc0e7b8de85e36 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:42.831917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525615-4c70-47ed-a5ed-f2555edfd1a4 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:42.881446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:42.881446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:42.881446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:42.881446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:42.884080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:42.887705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9272e-f394-4032-8491-d0ec611aaa42 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:42.888411 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 71/140] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:42.894413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:43.022044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047ac5-db60-4c23-a702-ee251f50fb10 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:43.061745 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:43.062457 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.062741 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.063022 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.063751 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:43.065209 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac496-9c9f-46f3-b156-a30dbd5ec8cb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:43.190328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 70/141] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:42 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:43.206504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fae21-8dbf-464e-988d-7fd0a08be949 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.206857 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fae21-8dbf-464e-988d-7fd0a08be949 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.207071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fae21-8dbf-464e-988d-7fd0a08be949 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.208801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 72/142] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:43.214308 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.214610 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.214897 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.237783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:43.239002 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:43.336995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 71/143] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:43.374793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fae21-8dbf-464e-988d-7fd0a08be949 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:43.500019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fae21-8dbf-464e-988d-7fd0a08be949 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:43.547391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:43.548213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.548496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.548771 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.564075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:43.572086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:43.573024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:43.574439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 73/144] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:43.579908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:43.687847 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7594d-40ab-43b8-8f1a-172888a9d314 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:43.725148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:43.725822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.726105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.726408 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.727165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:43.727466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:43.728853 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:43.737692 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 72/145] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:43.743520 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:43.849999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abc2d5-ea7f-4e75-98c2-3d02c97eff0b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:43.886772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:43.887676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:43.888186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:43.888697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] PATH_INFO: `/v3/users/e52b3f24e6b34799a0f486748ac41e63` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:43.890057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] RBAC: Authorizing `identity:get_user(user_id=e52b3f24e6b34799a0f486748ac41e63)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:43.891632 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:43.893396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 74/146] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:43 2022] GET /identity/v3/users/e52b3f24e6b34799a0f486748ac41e63 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:43.899109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:44.004061 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5948b2-ca2f-4e9e-8a83-ced64cfa043e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:44.039575 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:44.040440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:44.040725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:44.041004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:44.042770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:44.044304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf2d1d-eb21-4f9e-8cdd-d4dcfb630619 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:44.049715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 73/147] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:43 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:44.052226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:44.159353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978c4c-82b6-445b-aed5-2305bbac20f3 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:44.196125 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:44.197020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:44.197306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:44.197581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/e52b3f24e6b34799a0f486748ac41e63/roles/496b8e068e2f4068879475b6d41ffc56` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:44.199814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, user_id=e52b3f24e6b34799a0f486748ac41e63, role_id=496b8e068e2f4068879475b6d41ffc56)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:44.201400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fc368-973d-4e0b-9876-76ecb46b9dc7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:44.319152 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 75/148] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:44 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/users/e52b3f24e6b34799a0f486748ac41e63/roles/496b8e068e2f4068879475b6d41ffc56 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:44.626912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd53f-020d-4ad7-8cae-66193db09a1b None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:44.627863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd53f-020d-4ad7-8cae-66193db09a1b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:44.627863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd53f-020d-4ad7-8cae-66193db09a1b None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:44.629445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 74/149] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:44.635421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:44.636246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:44.636546 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:44.655530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:44.656724 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:44.736711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 76/150] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:44.765520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd53f-020d-4ad7-8cae-66193db09a1b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:44.877289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd53f-020d-4ad7-8cae-66193db09a1b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:44.911296 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:44.912098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:44.912385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:44.912667 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:44.924663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:44.932945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:44.933840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:44.934616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 75/151] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:44.941489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:45.047736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e45e-bf46-4830-9ff4-09253a148b11 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:45.082544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:45.083232 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.083518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.085194 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.085976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:45.086363 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:45.087910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:45.097470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 77/152] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:45.103359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:45.209538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125785a9-f2b2-42d0-b0c0-7ba6ebc47231 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:45.245948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:45.246865 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.247149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.247424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] PATH_INFO: `/v3/users/a20d203a05264464867ecc638e322e3e` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.248648 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] RBAC: Authorizing `identity:get_user(user_id=a20d203a05264464867ecc638e322e3e)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:45.250160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:45.252065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 76/153] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:45 2022] GET /identity/v3/users/a20d203a05264464867ecc638e322e3e => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:45.258083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:45.365760 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623ce6-3ec3-4645-bc3d-8fa35424f919 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:45.402840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:45.403506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.403795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.404074 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.478242 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:45.479773 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:45.586238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 78/154] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:45.592535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:45.695331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1a91-186b-42f9-a6fc-6b1c616cf334 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:45.734814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:45.735621 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.735903 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.736175 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.737401 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:45.739052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd337b-9d8b-4d60-9d0e-c22ab58466f3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:45.740785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 77/155] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:45 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:45.753716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:45.879157 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353e85-e1ee-4cb7-9bf2-643142f5b9f9 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:45.921470 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b73e-f8fb-4a80-8ed1-b105111907b1 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.921762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b73e-f8fb-4a80-8ed1-b105111907b1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.922033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b73e-f8fb-4a80-8ed1-b105111907b1 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.923426 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 78/156] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:45.926936 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:45.928477 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.928761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.929037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.940052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:45.940357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:45.940615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:45.941480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=a20d203a05264464867ecc638e322e3e) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:45.941790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:45.943303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:45.957283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:45.959636 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:45.964782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 79/157] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:45 2022] GET /identity/v3/role_assignments?user.id=a20d203a05264464867ecc638e322e3e&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=5067df1fd41e4852bda05f53294ab802 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:46.046030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 79/158] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:46.071016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:46.187256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba6095-bb84-43da-8d05-c9cb42bf2286 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:46.224630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:46.225439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.225719 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.225994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.238056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:46.247174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:46.249728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:46.251731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 80/159] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:46.258229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:46.410825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3e690-9f2c-456e-9aa2-3860dea1071e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:46.459162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:46.459854 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.460133 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.460409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.461176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:46.461480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:46.462926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56739-019b-411a-ad88-2bc50cb8ad18 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:46.478179 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 80/160] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:46.484335 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:46.505730 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda529b3-1e26-45c6-b2cc-3fb3fc182218 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.506060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda529b3-1e26-45c6-b2cc-3fb3fc182218 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.506320 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda529b3-1e26-45c6-b2cc-3fb3fc182218 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.507985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 81/161] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:46.520114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.520425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.520669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.559382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:46.560855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:46.639319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266c38-ec8c-4376-9e3b-8abca14fbac5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:46.683798 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:46.684655 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.684938 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.687775 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.689407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:46.690986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:46.696687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 81/162] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:46 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:46.712464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:46.725541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 82/163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:46.778358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:46.890420 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e5691-766f-449e-8521-6821cd66d527 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:46.969447 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:46.970041 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:46.970326 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:46.970595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:46.987889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4185a-5c54-4b8e-9027-981b9f5f8649 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:47.062410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:47.063227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.063508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.063777 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.077503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:47.081466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd6cae-6d49-45ff-bb0c-b96fd4b22638 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:47.087100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-99bf0583-45f1-4ea8-8d85-e1164a83a233 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:47.095240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:47.096232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:47.097010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 83/164] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:47.097656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e903-a0e8-464a-8152-e773b3fc6abc None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.098505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e903-a0e8-464a-8152-e773b3fc6abc None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.098505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e903-a0e8-464a-8152-e773b3fc6abc None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.107939 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 84/165] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:47.108603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e903-a0e8-464a-8152-e773b3fc6abc None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.197858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:38:47.204106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.204564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.204982 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.227502 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:47.230003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:47.344640 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e903-a0e8-464a-8152-e773b3fc6abc None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:47.387598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 83/167] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:47.388874 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.401458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:47.402814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.403299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.403802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.404841 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:47.405344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:47.407014 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:47.422454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 85/168] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:47.423691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.516460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a779f1-51d4-429a-8498-15ae19611fd9 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:47.569091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:47.570262 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.570687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.571135 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.573883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:47.575531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:47.581870 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 84/169] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:47.582943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.609660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0ad9-d919-458d-9d1c-cfd43a1ebe10 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:47.689988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:47.691086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.691532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.691956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.714986 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:47.726893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:47.728548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:47.729521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:47.732854 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 86/170] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:47.734123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.809362 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f4376-1be1-4e70-9093-a46adb48056a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:47.895485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:47.896362 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:47.896639 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:47.896913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:47.902988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:47.904451 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:47.906265 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 85/171] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:47.907045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:47.981889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb4720-d454-48e0-9ac1-d66676fabb2b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.063969 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.064557 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.064865 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.065109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.065941 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:48.066266 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.067723 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.081860 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 87/172] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:48.082768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:48.100018 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788d82-991e-4e34-a71b-c5a02ba5627e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.173243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.173939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.174238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.174694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.175470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:48.175774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.177167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.192814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 86/173] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:48.199298 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:48.327101 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55786-05a8-4e73-af19-615ec77a4411 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.368911 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be74c5-6ee7-4cd3-a89c-5ad8b050396d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.419466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.420584 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.421082 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.421482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.435030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.436531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.436813 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.437088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] PATH_INFO: `/v3/users/40d2b8384f224aedb6470ca4777a83ab` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.438438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2b8384f224aedb6470ca4777a83ab)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.439896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.442548 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 87/174] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/users/40d2b8384f224aedb6470ca4777a83ab => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:48.451324 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:48.508603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.510229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.619675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 88/175] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:48.625441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:48.671875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e9613-9b5f-4284-a1ed-836ffc36edf2 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.724788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.725575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.725780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.726011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.726664 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3900e-92ac-495e-a7ca-2b0ea13ec9d5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.763651 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.764493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.764772 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.765042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.766298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.767775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf338e8-08fb-4325-a3a9-a8e9df26e46c None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.769835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 89/176] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:48.775366 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebd71-90bc-40c2-a6a9-944d24229575 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.775684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebd71-90bc-40c2-a6a9-944d24229575 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.776008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebd71-90bc-40c2-a6a9-944d24229575 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.777539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 90/177] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:48.779297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ebd71-90bc-40c2-a6a9-944d24229575 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:48.825837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.835509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.889511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ebd71-90bc-40c2-a6a9-944d24229575 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:48.925567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:48.926259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.926530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.926803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.927688 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] RBAC: Adding query filter params (role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:48.927991 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:48.929596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4460a-987a-4fbe-8f76-460177703af4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:48.936241 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 91/178] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:48.937607 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155bd64-b844-4cf7-be9c-578d470b7375 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:48.937894 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155bd64-b844-4cf7-be9c-578d470b7375 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:48.938165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155bd64-b844-4cf7-be9c-578d470b7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:48.966039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d155bd64-b844-4cf7-be9c-578d470b7375 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:48.967406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d155bd64-b844-4cf7-be9c-578d470b7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:48.984337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 88/179] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:38:48.990359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.127937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 92/180] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:49.129277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874ced-dab6-4eef-92da-ea50a0a0abf6 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.129536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874ced-dab6-4eef-92da-ea50a0a0abf6 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.129815 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874ced-dab6-4eef-92da-ea50a0a0abf6 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.131237 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 93/181] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:49.139773 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cc59-3cd8-4657-a0ab-7a5bf2c630db None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.140035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cc59-3cd8-4657-a0ab-7a5bf2c630db None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.140702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627cc59-3cd8-4657-a0ab-7a5bf2c630db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.156200 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fab3e-e863-4998-af0b-0e09a6f18fd7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.169521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-9627cc59-3cd8-4657-a0ab-7a5bf2c630db None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:49.170744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-9627cc59-3cd8-4657-a0ab-7a5bf2c630db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:49.193407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.194336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.194626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.194904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] PATH_INFO: `/v3/projects/5f5b773cfbf641739a4d340e34e0b699` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.196274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] RBAC: Authorizing `identity:get_project(project_id=5f5b773cfbf641739a4d340e34e0b699)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.197787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb859af-3053-464d-be6e-44e22ed38d1c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:49.199969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 89/182] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:48 2022] GET /identity/v3/projects/5f5b773cfbf641739a4d340e34e0b699 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:49.201321 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed115-35cc-4fef-96ab-a1248781be92 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.201608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed115-35cc-4fef-96ab-a1248781be92 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.201894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed115-35cc-4fef-96ab-a1248781be92 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.203611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 90/183] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:49.204364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ed115-35cc-4fef-96ab-a1248781be92 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.260677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 94/184] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:49.262385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.262675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.262950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.280213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:49.281411 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:49.337952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ed115-35cc-4fef-96ab-a1248781be92 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.370746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 95/185] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:49.370746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.380978 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.381796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.382093 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.382383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.392637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:49.400243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:49.407162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 91/186] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:49.407939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.474934 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d3d45-9165-4d45-95c9-770d2a304c0b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.500621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca79b3-9c12-4b01-a752-5ff6fd750bc3 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.508417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.509059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.509341 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.509608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.510461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=5f5b773cfbf641739a4d340e34e0b699, user.id=40d2b8384f224aedb6470ca4777a83ab) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:49.510944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.512445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71cba-873f-4d1d-b406-54653f4c0a3e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:49.518053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 96/187] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/role_assignments?user.id=40d2b8384f224aedb6470ca4777a83ab&scope.project.id=5f5b773cfbf641739a4d340e34e0b699&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:49.519302 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb22-ebd5-44b7-aa1d-4a987bbc735d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.519599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb22-ebd5-44b7-aa1d-4a987bbc735d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.519851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7bb22-ebd5-44b7-aa1d-4a987bbc735d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.521066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 97/188] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:49.523083 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7bb22-ebd5-44b7-aa1d-4a987bbc735d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.544924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.545731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.546011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.546317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.558759 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:49.566860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:49.567884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:49.568699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 92/189] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:49.569352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.646353 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7bb22-ebd5-44b7-aa1d-4a987bbc735d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.686661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.687376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6c0b-9b1a-45b3-86f4-7783d1369ab7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.687485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.687736 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.688009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.689227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.690864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bd53c-fb71-4522-94ac-b9005028e3d6 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:49.692727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 98/190] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:49.693911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.697073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.697073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.713521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:49.715106 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:49.737566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.737898 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.738110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.738425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.739188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] RBAC: Adding query filter params (name=reader) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:49.739495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.740893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:49.750617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 93/191] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:49.751495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.789024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 99/192] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:49.789889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.858151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab67db-b820-4ee8-bbf1-80a129713ddb None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.887842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270427c0-65e8-43d2-87dd-2119984c41a9 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:49.891989 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.892662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.892949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.893231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.893981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:49.894323 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.895712 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:49.903793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 94/193] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:49.904539 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:49.921928 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:49.922639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:49.922987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:49.923196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:49.923921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:49.925381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.000917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24790d-7d76-41d6-b387-8fbf9a790784 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.032562 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.033412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.033688 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.033951 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] PATH_INFO: `/v3/users/e52b3f24e6b34799a0f486748ac41e63` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.035146 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] RBAC: Authorizing `identity:get_user(user_id=e52b3f24e6b34799a0f486748ac41e63)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.036625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.038234 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 95/194] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:49 2022] GET /identity/v3/users/e52b3f24e6b34799a0f486748ac41e63 => generated 289 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:50.039084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.060497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 100/195] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:49 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:50.061467 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.143926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b86e-6c2e-42b5-b4b8-42b74062961d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.170882 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e49a-4092-41d1-b9de-4f739bfe5d4d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.183779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.185267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.185718 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.185997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.197709 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:50.206469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:50.207427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:50.208317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 96/196] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:50.208981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.216095 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.216995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.217276 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.217615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.233716 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.235650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.237490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 101/197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:50.242855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.321805 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2348f-54d8-4176-b8fa-9a2dcbc67ede None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.362047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028e56-00c8-42be-bf6d-eaf49c07c33f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.371036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.371702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.371989 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.372269 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.413923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.416527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.416827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.417161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.418653 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:50.418789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.420402 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.429766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 102/198] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:50.430810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.461228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.462961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.562182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a156-8d76-4f29-9bee-5253f04cb46b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.575064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 97/199] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:50.575932 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.610488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.611527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.611884 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.612390 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.687663 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71528b8-6407-4017-bef7-5e2571fb08e4 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.698880 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.701368 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.724304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.725176 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.725457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.725730 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.727005 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.728597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.731218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 98/200] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:50.732023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.819996 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 103/201] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:50.826044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.842736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a269-dec4-4f08-90d1-772195daddb6 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.879855 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.880579 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.880910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.881187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.882422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:50.883885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:50.890816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 99/202] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:50.891747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:50.926710 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531fad2-fa29-42b8-b93a-d27f157ae2a1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:50.962159 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:50.963200 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:50.963719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:50.964332 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:50.996654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c02f-d24b-4105-b05c-1de5c3fe8f94 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:51.032654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:51.033520 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:51.033802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:51.034077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:51.035373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.035766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.036891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.037667 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.038884 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 100/203] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:51.043694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:51.141499 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 104/204] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:51.142761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:51.149410 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c385-7c36-43d8-819d-0509124dba41 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:51.184804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:51.185442 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:51.185733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:51.186008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:51.187090 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994, user.id=e52b3f24e6b34799a0f486748ac41e63) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:51.187221 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.188805 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.194942 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 101/205] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:51 2022] GET /identity/v3/role_assignments?user.id=e52b3f24e6b34799a0f486748ac41e63&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:51.195727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:51.248463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5109c-d8f1-4d1c-8bb9-68bb94e792a5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:51.285988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:51.287045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:51.287524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:51.287992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:51.289038 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=7333106f95b04941a62d9735c9700151) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:51.289765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.291542 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.298954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 105/206] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:51 2022] GET /identity/v3/role_assignments?user.id=7333106f95b04941a62d9735c9700151&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=5067df1fd41e4852bda05f53294ab802 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:51.347140 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c7b9-b713-4b51-990e-2bd492adc870 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:51.386989 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:51.387733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:51.388073 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:51.388349 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:51.389780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.391376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446550-2ab6-4c1e-afc4-c7259120d523 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.393244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 102/207] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:51 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:51.399518 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:51.578043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111494-c636-4b34-87cd-4f03c2397799 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:51.625728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:51.626486 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:51.626763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:51.627070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:51.628212 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] RBAC: Adding query filter params (role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=7333106f95b04941a62d9735c9700151) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:51.628521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:51.630008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc753-809c-4de0-bc57-309f626e85a7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:51.637271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 106/208] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:51 2022] GET /identity/v3/role_assignments?user.id=7333106f95b04941a62d9735c9700151&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:52.669028 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a49e2c-6279-48e8-9803-0efcb9471108 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:52.669559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a49e2c-6279-48e8-9803-0efcb9471108 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:52.669559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a49e2c-6279-48e8-9803-0efcb9471108 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:52.671009 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 103/209] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:52.676577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:52.676985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:52.677155 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:52.693765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:52.694999 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:52.705905 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d294c4-6cd2-497e-990f-a947765b8859 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:52.706213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d294c4-6cd2-497e-990f-a947765b8859 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:52.706515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d294c4-6cd2-497e-990f-a947765b8859 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:52.708063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 104/210] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:52.712922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:52.713214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:52.713494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:52.735091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:52.736316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:52.771310 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 107/211] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:52.797990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:52.824226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 105/212] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:52.869343 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:52.911103 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d78df-c657-4397-b9b2-6d6caead0981 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:52.947830 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:52.949149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:52.949432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:52.949705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:52.960588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:52.969000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:52.971458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:52.972643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 108/213] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:38:52.982221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:52.990447 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e57c-2e27-4114-90ca-4e8745ece7fc None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.025428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.027129 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.027689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.028069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.029351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.030954 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.037279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 106/214] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:53.038310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:53.076263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3632-c7d0-40a6-a9e4-7db57ac00971 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.109804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.110525 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.110804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.111078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.111816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:53.112118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.113496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.122779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 109/215] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:53.128478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:53.141194 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caf58-328c-46d5-a8d0-a064fcc5caa6 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.176445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.177148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.177482 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.177765 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.178535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.180000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.228535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abe9e-3fda-4ba7-ae35-101f43cd9d81 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.262203 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.263040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.271047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.271047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] PATH_INFO: `/v3/users/57d9ccb7b26a412781856fd9a6d9b05f` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.277389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] RBAC: Authorizing `identity:get_user(user_id=57d9ccb7b26a412781856fd9a6d9b05f)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.279008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.280856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 110/216] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:53 2022] GET /identity/v3/users/57d9ccb7b26a412781856fd9a6d9b05f => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:53.285952 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:53.384730 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e897f-b6a2-419c-a740-7824a7a3d8fd None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.418163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.418846 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.419125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.419396 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.486189 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.487599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.522605 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 107/217] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:53 2022] POST /identity/v3/users => generated 297 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:53.593847 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 111/218] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:38:53.599369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:53.720959 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abfb7d-b7ec-437e-90b8-1889d8067a3d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.769336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.769336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.769336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.769336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.769734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.769734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099e21a-f654-4914-b5ba-db8a0829fa41 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.769734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 108/219] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:53 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:53.772398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:53.890289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46b53-4d3e-49c6-af65-1d180979f88f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.890500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46b53-4d3e-49c6-af65-1d180979f88f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.890760 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46b53-4d3e-49c6-af65-1d180979f88f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.894138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 109/220] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:53.896351 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88be1-8f9d-490f-bf83-3c7cec607df9 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:53.899819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1246ed-b57a-4606-83fe-303adba67833 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.900241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1246ed-b57a-4606-83fe-303adba67833 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.900563 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1246ed-b57a-4606-83fe-303adba67833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.926395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ac1246ed-b57a-4606-83fe-303adba67833 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:53.927761 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ac1246ed-b57a-4606-83fe-303adba67833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:53.939997 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:53.940924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:53.941349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:53.941772 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:53.942820 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=57d9ccb7b26a412781856fd9a6d9b05f) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:53.943290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:53.944909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:53.953980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 112/221] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:53 2022] GET /identity/v3/role_assignments?user.id=57d9ccb7b26a412781856fd9a6d9b05f&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:54.015703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 110/222] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:54.040357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.093480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063250-67d2-41d2-aab0-1e5f0d40348e None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.094130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063250-67d2-41d2-aab0-1e5f0d40348e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.094633 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063250-67d2-41d2-aab0-1e5f0d40348e None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.096583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 111/223] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:54.103515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.104284 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.105285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.126017 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:54.128015 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:54.162232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c0d55-c650-49ea-aca9-26bbb6dc8580 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.192266 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.193042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.193318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.193586 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.204907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:54.212077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:54.213122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:38:54.214690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 113/224] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:54.220117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.224352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 112/225] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:54.249839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.416514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dae293-216d-49df-8638-1b7b64ba291a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.447559 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e980-7a59-49f6-8774-b0d62d832877 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.471063 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.471747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.472033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.472313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.473066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:54.473372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:54.482983 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:54.494504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 114/226] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:54.501885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.506915 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.507796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.508078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.512302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.533747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:54.551703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:54.552652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:54.553436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:54.558822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 113/227] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:54.561226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.701131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebead235-e181-4ba1-99bb-cd0439997eb2 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.764150 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.764366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826526-2449-4ba1-88c8-fe9e1305359c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.764826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.764826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.764826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.765411 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:54.767049 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:54.768900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 115/228] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:54.778222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.826999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.830463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.830463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.830463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.830463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:54.830463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:54.831465 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:54.844408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 114/229] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:54.850216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:54.879808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d1b6-c60e-4f97-b918-c23d8207ceb1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:54.938422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:54.940414 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:54.941144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:54.941442 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:54.949759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:54.951440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:54.953227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 116/230] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:54.964294 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:55.054057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8895b09-645d-4480-91c0-7facc11177e1 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:55.113093 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:55.113975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:55.114328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:55.114609 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:55.115822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:55.119131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:55.120974 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 115/231] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:54 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:55.128476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:55.156705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495d4c4-0b31-488d-a5e4-1c8e68bcc87b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:55.194827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:55.195715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:55.195988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:55.196255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/7333106f95b04941a62d9735c9700151/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:55.199493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, user_id=7333106f95b04941a62d9735c9700151, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:55.200913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:55.271732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d6c7b-9aaa-4a60-bb44-a4521e6b9019 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:55.293866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 117/232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:54 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/7333106f95b04941a62d9735c9700151/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:55.318049 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:55.319495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:55.319998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:55.320479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:55.327251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:55.329146 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0ae55-2b9e-47f9-a24d-980a8d6171d7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:55.331284 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 116/233] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:55 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:55.337421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:55.492339 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff936fc0-783d-4047-9351-86ecc7a97300 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:55.535716 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:55.536541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:55.536825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:55.537102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/7333106f95b04941a62d9735c9700151/roles/c0065defbccb49c69fbc0e7b8de85e36` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:55.540936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, user_id=7333106f95b04941a62d9735c9700151, role_id=c0065defbccb49c69fbc0e7b8de85e36)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:55.543091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89987c0-4fe1-42d8-906e-9ba4bb555d31 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:55.726889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 118/234] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:55 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/7333106f95b04941a62d9735c9700151/roles/c0065defbccb49c69fbc0e7b8de85e36 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:56.663135 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61e96b-ec51-486f-ab19-1d7c774dc09e None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.664052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61e96b-ec51-486f-ab19-1d7c774dc09e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.664507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61e96b-ec51-486f-ab19-1d7c774dc09e None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.666081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 117/235] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:56.671728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be054a-be4f-4a66-ad4c-7644d7d56daa None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.672151 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be054a-be4f-4a66-ad4c-7644d7d56daa None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.672283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be054a-be4f-4a66-ad4c-7644d7d56daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.694143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d1be054a-be4f-4a66-ad4c-7644d7d56daa None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:56.695659 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d1be054a-be4f-4a66-ad4c-7644d7d56daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:56.745222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17b11-22bc-408b-9fe8-cc5bc670a506 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.745519 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17b11-22bc-408b-9fe8-cc5bc670a506 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.745952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17b11-22bc-408b-9fe8-cc5bc670a506 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.749088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 118/236] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:56.762882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.763265 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.763597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.780779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 119/237] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:56.781031 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:56.782409 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:56.782821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a302-d21b-432c-b007-f1fec58ccf55 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.783264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a302-d21b-432c-b007-f1fec58ccf55 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.783797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a302-d21b-432c-b007-f1fec58ccf55 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.785261 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 120/238] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:56.793100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:56.793100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:56.793100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:56.811549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:56.812734 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:56.879583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 119/239] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:56.880541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:56.910174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 121/240] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:38:56.930676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:56.984378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db04d-69a3-401b-bc7c-975ee875618a None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.019536 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.020570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.020995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.021408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.036620 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:57.046386 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce60e5-6387-405c-9e46-08cd5c11f800 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:57.047341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:57.048384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:38:57.049329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:57.049947 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 120/241] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:57.056154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.094574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.095665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.096315 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.096764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.098966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.100677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.102863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 122/242] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:57.103848 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.170058 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeae49e-3901-4377-aab8-4bf49f31823a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.204163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.205211 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.205646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.206075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.208065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13830f0-1c9a-4889-a6e0-16ae00b66714 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.217505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:57.225570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:57.230436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 121/243] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:57.231239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.248996 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.249672 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.249950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.250235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.250979 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:57.251277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.252913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.266122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 123/244] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:57.267058 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.339605 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003740f8-873c-41ea-b0f0-88559acc6822 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.368562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a4731-83eb-40a6-abf9-fec313ce8019 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.376774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.378054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.378542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.379016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.379895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.381532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.405829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.406533 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.406814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.407087 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.407824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:57.408122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.409487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.417816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 124/245] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:57.421895 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.515279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 122/246] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:38:57 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:38:57.516438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.553424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4ec1-845f-495d-b1a8-e82ae5757dc7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.623628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.626400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.627025 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.630330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] PATH_INFO: `/v3/users/c2a426a52d5e409a8018386920a8a8c6` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.647406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a426a52d5e409a8018386920a8a8c6)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.649264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.652023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 125/247] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/users/c2a426a52d5e409a8018386920a8a8c6 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:57.657542 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.716273 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb27c17-8090-4f31-94f8-9c5ed50559e0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.791230 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b5d7-3aa2-4251-9824-6b1c521c5179 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:57.809783 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.810740 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.811023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.811413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] PATH_INFO: `/v3/users/57d9ccb7b26a412781856fd9a6d9b05f` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.815958 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=57d9ccb7b26a412781856fd9a6d9b05f)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.818558 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.821618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 123/248] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/users/57d9ccb7b26a412781856fd9a6d9b05f => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:57.828275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:57.845590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:57.846635 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:57.847511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:57.847987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:57.959989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:57.961483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7edbb2-a608-413e-b9dc-55b944e5dce8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:57.976782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e759a-3d4b-4988-b7a3-c9394df0e7a3 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.035175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.036883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.037528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.038041 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.039466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:58.040911 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cffab4-bc4c-4a41-a8a9-9f48057b5dfd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:58.044088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 124/249] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:58.045386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e715-89e4-40cf-b9a3-a0339186f100 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.045670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e715-89e4-40cf-b9a3-a0339186f100 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.045949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e715-89e4-40cf-b9a3-a0339186f100 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.050227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 125/250] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:38:58.050227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e715-89e4-40cf-b9a3-a0339186f100 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.098337 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 126/251] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:38:58.100670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.101161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.101618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.121190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:58.122807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:58.178731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e715-89e4-40cf-b9a3-a0339186f100 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.206929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 127/252] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:58.208118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.220447 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.221732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.222016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.222316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/57d9ccb7b26a412781856fd9a6d9b05f/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.224847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, user_id=57d9ccb7b26a412781856fd9a6d9b05f, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:58.226927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:58.330256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406b6d-43cc-4aba-a355-da8a72d67d79 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.330562 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 126/253] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:38:58 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/57d9ccb7b26a412781856fd9a6d9b05f/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:38:58.331454 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.426932 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.428214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.428699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.429185 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.430747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:58.432602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:58.434750 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 128/254] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:58 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:58.449073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.483604 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc9ba-9bf4-4e52-8f69-25d3d2995b50 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.528273 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.529087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.529373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.529649 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.556897 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:58.566838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:58.567796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:58.568680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 127/255] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:58.576644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.700271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee962-a5bb-4196-be3c-1792734dddad None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.721988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84789c0-dcf3-4ec2-96cb-d1e502614ddb None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:58.753894 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.754589 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.754876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.755151 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.755988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=c2a426a52d5e409a8018386920a8a8c6) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:58.756298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:58.757749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:58.764660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:58.765142 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 129/256] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:58 2022] GET /identity/v3/role_assignments?user.id=c2a426a52d5e409a8018386920a8a8c6&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:58.765629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.765914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.766187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.766966 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:58.767271 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:58.768737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a204d-a0b6-45a9-bc00-141f7fb32e1a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:58.787443 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 128/257] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:58.793326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:58.864300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2bb1-3858-4be9-a87c-046ba5dc52ba None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.864618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2bb1-3858-4be9-a87c-046ba5dc52ba None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.864860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2bb1-3858-4be9-a87c-046ba5dc52ba None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.866570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 129/258] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:38:58.883479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:58.883883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:58.884167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:58.920606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:38:58.921832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:38:58.948835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339d11b-e636-483e-a868-0aa503ef0eff None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.011681 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.012765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.012765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.013694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.018278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:59.022227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:59.022802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 130/259] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:58 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:59.028684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.083902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 130/260] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:38:59.119515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.239027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4c1fe-6dcf-46b7-a2df-f032d9b76533 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.305019 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.307255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2994ae-5ed4-43dd-8622-cf27aa88c1db None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.312668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.312668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.312668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.363003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.363827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.364114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.364394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.383551 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:38:59.402495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:38:59.403437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:38:59.404241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:38:59.410613 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 131/261] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:38:59.415583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.457267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:59.458833 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:59.600122 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5f7fa-fe7e-417b-9a04-183100e1ada8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.644876 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.645600 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.645839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.646119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.647631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:38:59.647631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:59.648601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:59.669258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 132/262] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:59.674660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.680092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 131/263] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:38:59.686602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.816081 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4689c-099a-4e73-8e40-23b156a125a8 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.834078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858cf4e-c6fd-465f-886a-6ec4b65f8e80 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:38:59.860259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.861457 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.861951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.862475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.866921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:59.868664 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:59.870912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 132/264] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:38:59.882311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.888434 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:38:59.889685 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:38:59.890231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:38:59.890659 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] PATH_INFO: `/v3/users/7333106f95b04941a62d9735c9700151` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:38:59.894915 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] RBAC: Authorizing `identity:get_user(user_id=7333106f95b04941a62d9735c9700151)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:38:59.896637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:38:59.898809 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 133/265] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/users/7333106f95b04941a62d9735c9700151 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:38:59.904825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:38:59.979714 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949c13b-d9e6-4436-b38f-043b649378f4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:00.016530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f44bb8-91ac-437a-b2b5-3ad832001697 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:00.024213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:00.025024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:00.025401 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:00.025776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:00.027013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=7333106f95b04941a62d9735c9700151) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:00.027427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:00.028972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:00.041602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 133/266] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/role_assignments?user.id=7333106f95b04941a62d9735c9700151&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=5067df1fd41e4852bda05f53294ab802 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:00.059871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:00.060551 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:00.060836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:00.061110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:00.177799 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:00.179303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:00.326009 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 134/267] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:00.331424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:00.470234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a3b8e-7b2c-4337-83f3-19a859edaa72 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:00.509638 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:00.510631 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:00.510917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:00.511195 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:00.512405 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:00.513866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efc7de-4aee-4b68-b5a8-11f14bc985a2 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:00.519792 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 134/268] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:00 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:00.527329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:00.674399 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabebdb-2f52-450a-834d-59e91da27011 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:00.721723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:00.722323 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:00.722601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:00.722873 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:00.723699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] RBAC: Adding query filter params (role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=7333106f95b04941a62d9735c9700151) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:00.724009 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:00.725456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99547015-2310-40f4-829a-b2243f7fedce None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:00.732035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 135/269] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:00 2022] GET /identity/v3/role_assignments?user.id=7333106f95b04941a62d9735c9700151&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:01.148951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc159-f9d2-49cd-9fe9-90164d2f3d83 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.149896 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc159-f9d2-49cd-9fe9-90164d2f3d83 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.150348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dc159-f9d2-49cd-9fe9-90164d2f3d83 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.152829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 135/270] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:01.158492 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.159279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.159557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.178666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104c57b-db0d-44bc-946a-bd449a01989d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.179279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104c57b-db0d-44bc-946a-bd449a01989d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.179853 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104c57b-db0d-44bc-946a-bd449a01989d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.180472 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:01.181696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:01.182158 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 136/271] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:01.188613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.189182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.189659 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.207808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:01.209356 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:01.290226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 136/272] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:01.308628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 137/273] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:01.367635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:01.372076 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:01.507202 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd29cd-632e-4648-b840-148ba60db4ed None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:01.555461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:01.557824 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.558272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.558667 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.579594 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:01.592946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:01.593913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:01.594750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:01.598155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 137/274] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:01.601299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb7fb-209f-4ecc-a222-9e4b81905201 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:01.607961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:01.692803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:01.693839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.693951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.694135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.700015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:01.704883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:01.711810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 138/275] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:01.720593 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:01.727798 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c605e8-936c-4e47-8735-cad57ed2937f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:01.772010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:01.772603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.772889 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.773169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.773917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:01.774249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:01.775635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32f3b9-cafd-43e5-9b00-eee3913a5751 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:01.785622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 138/276] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:01.787370 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0659e-615c-473f-ab9e-980d4bb1f2cf None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.787661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0659e-615c-473f-ab9e-980d4bb1f2cf None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.787944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0659e-615c-473f-ab9e-980d4bb1f2cf None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.790277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 139/277] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:01.791067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0659e-615c-473f-ab9e-980d4bb1f2cf None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:01.850357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2afbc8-381f-4344-b471-770e747e30ac None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:01.890188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:01.890878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.891163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.891437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.892137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:01.893571 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:01.901680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0659e-615c-473f-ab9e-980d4bb1f2cf None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:01.938129 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:01.939044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.939327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.939603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] PATH_INFO: `/v3/users/4941084f08e147e8be1bb5e973d6975c` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.954991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] RBAC: Authorizing `identity:get_user(user_id=4941084f08e147e8be1bb5e973d6975c)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:01.956516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710a2bc-f6b9-4900-8b0a-dc12b36c4e99 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:01.958339 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 140/278] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:01 2022] GET /identity/v3/users/4941084f08e147e8be1bb5e973d6975c => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:01.959596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:01.959881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:01.960157 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:01.976909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:01.978133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:02.029417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 139/279] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:39:01 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:02.039407 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.049179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 141/280] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:02.075086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.176021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dc37-cac6-46c9-af3e-f9ed04698e9e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.192689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba4571-8ffc-4244-8c82-3d3dd26a6200 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.212017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.212691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.212975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.213281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.214134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, user.id=4941084f08e147e8be1bb5e973d6975c, scope.system=all) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:02.214491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:02.216235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5c251-f080-4caa-8504-173dec48e445 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:02.221808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 140/281] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/role_assignments?user.id=4941084f08e147e8be1bb5e973d6975c&scope.system=all&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:02.223167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213b87-27d5-424c-ab1d-999837372b4f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.223459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213b87-27d5-424c-ab1d-999837372b4f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.223741 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213b87-27d5-424c-ab1d-999837372b4f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.225032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 141/282] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:02.236521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.236732 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.237126 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.237325 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.237523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.237695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.237967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.254897 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:02.261436 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:02.262713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:02.263979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:02.264887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:02.265697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:02.268640 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 142/283] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:02.274246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.349065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 142/284] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:02.377319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63163bb6-f862-44c1-92db-d1c38878b031 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.455520 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.456401 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.456686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.456966 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.457729 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:02.458045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:02.459496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:02.469238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 143/285] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:02.475195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.516949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbe80d-0d26-4d0a-a422-4d8b6ec2b4e4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.556072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.556843 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.557650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.558636 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.569639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:02.578294 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b3b3e-a49f-4f60-8d4d-8cc47a9c5461 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:02.578821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:02.579691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:02.580488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 143/286] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:02.591225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.635039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.635994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.636319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.636598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] PATH_INFO: `/v3/users/57d9ccb7b26a412781856fd9a6d9b05f` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.639063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] RBAC: Authorizing `identity:get_user(user_id=57d9ccb7b26a412781856fd9a6d9b05f)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:02.640614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:02.642771 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 144/287] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/users/57d9ccb7b26a412781856fd9a6d9b05f => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:02.647553 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.770615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43387e-92d8-4c93-8659-138060738078 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.810363 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.811401 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.811903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.812421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.829523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fedf1-6b8c-4339-8993-73fc1ef751cb None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:02.905535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:02.906128 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:02.906431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:02.906706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:02.907460 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:02.907763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:02.909160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:02.928534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 144/288] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:02.935136 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:02.950921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:02.953043 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.056230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 145/289] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:39:03.067337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:03.087768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb098c-3353-4b3b-8e83-c4448112f981 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:03.172120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:03.172940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:03.173218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:03.173488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] PATH_INFO: `/v3/users/c2a426a52d5e409a8018386920a8a8c6` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:03.179015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] RBAC: Authorizing `identity:get_user(user_id=c2a426a52d5e409a8018386920a8a8c6)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:03.180505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.182746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 145/290] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:02 2022] GET /identity/v3/users/c2a426a52d5e409a8018386920a8a8c6 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:03.188354 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:03.215645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1345e-6b7d-4c9c-8e36-3ebb037a8cf6 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:03.297564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:03.298470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:03.298750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:03.299023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:03.300431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:03.301873 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.303608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 146/291] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:03 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:03.310152 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:03.342470 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c9b0b-fa76-4918-99c9-259157bf296f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:03.408211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:03.409116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:03.409398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:03.409668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:03.410963 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:03.412417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.417271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 146/292] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:03 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:03.421721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:03.507171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919eb0d-1a2f-4d5a-ad10-9a7dee6a0efb None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:03.544269 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cfdd3-8fc6-4f39-b17b-5c9ad9e15bfc None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:03.580546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:03.581837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:03.582392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:03.582886 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/c2a426a52d5e409a8018386920a8a8c6/roles/496b8e068e2f4068879475b6d41ffc56` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:03.585325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, user_id=c2a426a52d5e409a8018386920a8a8c6, role_id=496b8e068e2f4068879475b6d41ffc56)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:03.587239 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d56d0-1510-435e-a1cd-c60ec831faac None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.591593 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:03.593525 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:03.594742 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:03.595240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:03.596364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=57d9ccb7b26a412781856fd9a6d9b05f) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:03.596926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:03.598729 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad829-31cb-4354-b457-c495b5568ccc None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:03.606353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 147/293] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:03 2022] GET /identity/v3/role_assignments?user.id=57d9ccb7b26a412781856fd9a6d9b05f&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:03.706279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 147/294] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:03 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/users/c2a426a52d5e409a8018386920a8a8c6/roles/496b8e068e2f4068879475b6d41ffc56 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:04.772913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaf0cc-634e-4081-8ebb-321c18fc50c5 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.774005 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaf0cc-634e-4081-8ebb-321c18fc50c5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.774521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaf0cc-634e-4081-8ebb-321c18fc50c5 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.777086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 148/295] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:04.783270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.784184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.784692 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.802481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:04.803993 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:04.834218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742416-ff6c-4b30-bddf-a2e379459382 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.834218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742416-ff6c-4b30-bddf-a2e379459382 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.834218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742416-ff6c-4b30-bddf-a2e379459382 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.834218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 149/296] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:04.841554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24217f2-cd36-44a3-a224-4f813860bd57 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.841840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24217f2-cd36-44a3-a224-4f813860bd57 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.842122 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24217f2-cd36-44a3-a224-4f813860bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.863220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-c24217f2-cd36-44a3-a224-4f813860bd57 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:04.869479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c24217f2-cd36-44a3-a224-4f813860bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:04.896649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 148/297] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:04.923105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:04.945394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 150/298] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:04.953138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada3e-5d33-4900-b3b0-47bd87ca9042 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.953138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada3e-5d33-4900-b3b0-47bd87ca9042 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.953138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada3e-5d33-4900-b3b0-47bd87ca9042 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.953138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 151/299] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:04.958070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:04.958389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:04.958666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:04.976166 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:04.977343 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:05.023697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7813a0d-c91f-48fe-af05-fe79e4e62e66 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.046656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 152/300] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:05.055163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.064766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.065532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.065816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.066093 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.077763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:05.085572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:05.086474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:05.087248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 149/301] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:05.087982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.164286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc05a7-d91d-4368-bb87-3733db60f2ae None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.191608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2fe0-6cb5-4f84-8182-53791243863d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.199834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.200665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.201013 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.201290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.211663 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:05.219896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:05.220953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:05.221776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 153/302] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:05.222485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.235914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.237002 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.237288 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.237567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.239380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.241300 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.243430 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 150/303] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.244099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.336495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1cc07-a323-4dd4-a97a-f86c0bbde6ac None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.348943 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cdef2-b60e-4314-bb4e-1bb436ae043a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.374774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.375446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.375730 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.376081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.376829 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:05.377138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.378834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.383232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.383918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.384199 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.384479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.385829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:05.386141 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.387555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.388717 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 154/304] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.389710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.400750 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 151/305] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.401903 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.499284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58985e-c65f-4f0b-af61-ddfdc9888250 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.499479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78903-d77c-43d9-9c59-c60ca23f4936 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.533215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.533574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.534078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.534180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.534373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.534448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.534644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] PATH_INFO: `/v3/users/fe6573d529cf499fa7355ff7f04a5a44` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.534764 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] PATH_INFO: `/v3/groups` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.535386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.536817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.548193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6573d529cf499fa7355ff7f04a5a44)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.549647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.551454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 152/306] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/users/fe6573d529cf499fa7355ff7f04a5a44 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.552208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.648278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467f46b-18ad-401a-a9ab-91a153ffae16 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.658227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 155/307] 10.222.0.44 () {60 vars in 1134 bytes} [Thu May 12 16:39:05 2022] POST /identity/v3/groups => generated 229 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:05.658227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.704958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.705893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.706181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.706510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] PATH_INFO: `/v3/users/4941084f08e147e8be1bb5e973d6975c` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.708761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] RBAC: Authorizing `identity:get_user(user_id=4941084f08e147e8be1bb5e973d6975c)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.711000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.718421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 153/308] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/users/4941084f08e147e8be1bb5e973d6975c => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.720858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:05.787911 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1df3-ede3-450a-98c8-f126fcbd5d28 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.830872 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.832133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.832418 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.832695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.833971 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, user.id=fe6573d529cf499fa7355ff7f04a5a44, scope.system=all) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:05.834319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.836508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e24fd-01bf-48f2-9544-01cd90a656c8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:05.844112 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 156/309] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 12 16:39:05 2022] GET /identity/v3/role_assignments?user.id=fe6573d529cf499fa7355ff7f04a5a44&scope.system=all&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:05.867655 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3bb4d-2397-406e-bc30-24166f8d47c8 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:05.921871 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:05.923216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:05.923703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:05.924180 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] PATH_INFO: `/v3/system/users/4941084f08e147e8be1bb5e973d6975c/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:05.925962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4941084f08e147e8be1bb5e973d6975c, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:05.927749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6d056-4a49-41f9-9df3-1f313b633451 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:06.049278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 154/310] 10.222.0.44 () {58 vars in 1334 bytes} [Thu May 12 16:39:05 2022] PUT /identity/v3/system/users/4941084f08e147e8be1bb5e973d6975c/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:06.265027 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba46d9-9d8c-4615-b879-e6ded767870a None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:06.265364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba46d9-9d8c-4615-b879-e6ded767870a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:06.265555 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba46d9-9d8c-4615-b879-e6ded767870a None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:06.266934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 157/311] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:06.272360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:06.272752 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:06.272975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:06.290573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:06.292592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:06.362495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 155/312] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:06.388747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba46d9-9d8c-4615-b879-e6ded767870a None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:06.498175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba46d9-9d8c-4615-b879-e6ded767870a None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:06.534908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:06.535631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:06.535909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:06.536181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:06.548162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:06.556061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:06.557552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:06.558365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:06.558977 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 158/313] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:06.563940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:06.665926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e65a4-f0a7-4b49-94dd-e503c043722d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:06.702320 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:06.702991 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:06.703269 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:06.703538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:06.704271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:06.704566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:06.705933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:06.714845 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 156/314] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:06.720489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:06.823455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687fc2-3384-4b67-9a9f-242515ca0fa7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:06.857818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:06.859039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:06.863533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:06.863533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] PATH_INFO: `/v3/users/c2a426a52d5e409a8018386920a8a8c6` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:06.863533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] RBAC: Authorizing `identity:get_user(user_id=c2a426a52d5e409a8018386920a8a8c6)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:06.863533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:06.864822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 159/315] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:06 2022] GET /identity/v3/users/c2a426a52d5e409a8018386920a8a8c6 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:06.874002 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:06.986225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdebd-47ff-40b1-922e-f58a1e345ee7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:07.021955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:07.022992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:07.023494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:07.024165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:07.096071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:07.097458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:07.200098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 157/316] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:07.205737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:07.307226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ee38-1f61-4df9-8f28-6a6ee44c3479 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:07.341402 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:07.342306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:07.342586 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:07.342862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:07.344062 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:07.345502 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61afd16-f052-48ea-9566-328804339a89 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:07.347296 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 160/317] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:07 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:07.353012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:07.458299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fb63-9076-4047-80e7-ca7207639f38 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:07.493474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:07.494131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:07.494981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:07.495260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:07.496191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3, user.id=c2a426a52d5e409a8018386920a8a8c6) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:07.496503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:07.497951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0d82-d844-4940-9a8f-53a99f4a35c1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:07.504526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 158/318] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:07 2022] GET /identity/v3/role_assignments?user.id=c2a426a52d5e409a8018386920a8a8c6&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:08.209049 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d29-6f8a-4ac1-b349-5b49280d732f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.209554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d29-6f8a-4ac1-b349-5b49280d732f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.209554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d29-6f8a-4ac1-b349-5b49280d732f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.210979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 161/319] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:08.217481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.218034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.218034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.237356 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:08.238639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:08.276548 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc0fd-58cd-4fcc-9d92-4f934b7fd6bb None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.276920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc0fd-58cd-4fcc-9d92-4f934b7fd6bb None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.277135 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc0fd-58cd-4fcc-9d92-4f934b7fd6bb None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.278576 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 162/320] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:08.283963 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.284248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.284528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.302060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:08.303316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:08.315759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 159/321] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:08.340017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.389707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 163/322] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:08.413014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.449329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7784d-ada9-4a51-9729-7254b2c6a9e1 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.485954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:08.486699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.486987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.487373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.488549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:08.490021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480025e-c876-4db9-a4e5-ec02d18ac7c5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:08.491709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 160/323] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:08.492926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc495a1-e256-41fe-beba-ea422d3ee747 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.493263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc495a1-e256-41fe-beba-ea422d3ee747 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.493486 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc495a1-e256-41fe-beba-ea422d3ee747 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.495893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 161/324] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:08.499320 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc495a1-e256-41fe-beba-ea422d3ee747 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.521128 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cf994-bd31-4db0-9843-de1f1cb4169f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.552951 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:08.553735 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.554012 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.554315 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.565049 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-c47f44af-a977-4eb2-bb9e-6a2375a9f36e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:08.573457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:08.574369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:08.575162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 164/325] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:08.576008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.576227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.576674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.595855 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:08.597034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:08.600377 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc495a1-e256-41fe-beba-ea422d3ee747 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.634385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:08.635071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.635349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.635617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] PATH_INFO: `/v3/groups` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.636290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:08.637718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:08.662846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 165/326] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:08.663731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.759460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813ab3-a4d1-4c01-9710-a42721e71543 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.773099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 162/327] 10.222.0.44 () {60 vars in 1134 bytes} [Thu May 12 16:39:08 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:08.776393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.802345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:08.803046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.803322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.803602 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.804398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:08.804704 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:08.806138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:08.815406 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 166/328] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:08.821334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:08.934530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fdf37-bbc1-471f-8ee9-a6a3b9dfd662 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.973827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bebb1-101b-467e-aa46-8edf80904cc7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:08.981046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:08.981861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:08.982137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:08.982460 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:08.999307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:09.007767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:09.008660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:09.009435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:09.012178 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 163/329] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:09.016856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:09.017924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:09.018389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:09.018878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:09.019394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] PATH_INFO: `/v3/users/fe6573d529cf499fa7355ff7f04a5a44` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:09.021499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] RBAC: Authorizing `identity:get_user(user_id=fe6573d529cf499fa7355ff7f04a5a44)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:09.024272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:09.027802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 167/330] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:08 2022] GET /identity/v3/users/fe6573d529cf499fa7355ff7f04a5a44 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:09.032946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:09.134475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bef-c987-4cbe-9723-ecbc3979ee1f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:09.155190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0c250-900c-4785-aac6-e33499d124be None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:09.172543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:09.173486 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:09.174242 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:09.174527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:09.175549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:09.175857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:09.177817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:09.189174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 164/331] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:09.194708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:09.204822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:09.205697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:09.205979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:09.212518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] PATH_INFO: `/v3/system/users/fe6573d529cf499fa7355ff7f04a5a44/roles/496b8e068e2f4068879475b6d41ffc56` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:09.212518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fe6573d529cf499fa7355ff7f04a5a44, role_id=496b8e068e2f4068879475b6d41ffc56)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:09.212518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3af51-a197-4ef2-bdfe-baa0365c32ca None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:09.307699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16577e86-e3c4-4eba-acf8-107e5146a159 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:09.346945 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:09.347824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:09.348105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:09.348377 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] PATH_INFO: `/v3/users/4941084f08e147e8be1bb5e973d6975c` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:09.349601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] RBAC: Authorizing `identity:get_user(user_id=4941084f08e147e8be1bb5e973d6975c)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:09.351134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:09.352858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 165/332] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:09 2022] GET /identity/v3/users/4941084f08e147e8be1bb5e973d6975c => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:09.357809 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 168/333] 10.222.0.44 () {58 vars in 1334 bytes} [Thu May 12 16:39:09 2022] PUT /identity/v3/system/users/fe6573d529cf499fa7355ff7f04a5a44/roles/496b8e068e2f4068879475b6d41ffc56 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:09.360456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:09.498187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f82e-6370-4fb6-ab61-5560c2f10678 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:09.542346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:09.543035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:09.543322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:09.543603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:09.544457 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] RBAC: Adding query filter params (role.id=c9f667508a63410faf255ae6b67c8ffd, user.id=4941084f08e147e8be1bb5e973d6975c, scope.system=all) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:09.544770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:09.546278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfaef-994d-425b-85df-d3bb96361174 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:09.560705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 166/334] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 12 16:39:09 2022] GET /identity/v3/role_assignments?user.id=4941084f08e147e8be1bb5e973d6975c&scope.system=all&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:12.260528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b175b51-736e-47d7-a692-2f69b055c260 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.261263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b175b51-736e-47d7-a692-2f69b055c260 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.261263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b175b51-736e-47d7-a692-2f69b055c260 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.262882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 169/335] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:12.280890 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.281412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.281599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.307652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:12.308876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:12.366819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216091-98af-49c1-91c5-46ec94bbc5e4 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.367448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216091-98af-49c1-91c5-46ec94bbc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.367945 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216091-98af-49c1-91c5-46ec94bbc5e4 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.371188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 170/336] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:12.375623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.376187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.376659 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.396209 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 167/337] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:12.411391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:12.412942 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:12.433151 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:12.528370 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 171/338] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:12.573277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f070-5550-4ffb-90f8-a24ecb8398c4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:12.575239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:12.653990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:12.654814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.655099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.655372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.677562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:12.685565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:12.686483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:12.687323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:12.688529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 168/339] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:12.700749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:12.769885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d7546-92ea-4dd2-b381-d659cf49e7b1 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:12.841611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:12.842534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.842825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.843101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.868158 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b977fda9-6550-47da-b74c-f8d650412755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:12.890245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:12.891435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 172/340] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:12.892217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d57ee-9319-4b54-b04d-a037a52619b7 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.892916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d57ee-9319-4b54-b04d-a037a52619b7 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.892916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d57ee-9319-4b54-b04d-a037a52619b7 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.894005 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 173/341] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:12.899840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.900291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.900726 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.904955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543fbfa-4f9f-46b9-a038-926590c1ddd7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:12.918814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:12.920010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:12.969350 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:12.970045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:12.970380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:12.970663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:12.971424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:12.971733 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:12.973137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:12.984642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 169/342] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:12.985511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.063405 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 174/343] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:13.064278 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.190869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051ad3-0230-469e-9bc1-63bd7c1405fb None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:13.201079 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d668bfc-dff5-468a-b718-701cac02ba94 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:13.238306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:13.239132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.239540 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.239820 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.257301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:13.257977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.258728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.259139 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.260482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:13.260792 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:13.262506 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:13.279373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 170/344] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:13.280260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.335209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:13.336702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c4cc7-ae33-498e-8ef4-9917f8aa77c5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:13.393619 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe554d-e2c3-4a74-a78a-f82debe2bd3c None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:13.445906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:13.447077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.447619 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.448165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.459689 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-bc0d7cf0-c7b4-4703-af6e-c826fb96b8e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:13.468582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:13.469528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:13.472615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 171/345] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:13.473533 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8e94-0f77-4c79-ba56-75dfbfbe620e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.473831 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8e94-0f77-4c79-ba56-75dfbfbe620e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.474112 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f8e94-0f77-4c79-ba56-75dfbfbe620e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.475581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 172/346] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:13.476511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c603-ba5a-447c-a256-dd5df48d0b35 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.476861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c603-ba5a-447c-a256-dd5df48d0b35 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.477140 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64c603-ba5a-447c-a256-dd5df48d0b35 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.479712 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 173/347] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:13.480438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c603-ba5a-447c-a256-dd5df48d0b35 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.481399 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 175/348] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:13.483507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.483507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.483788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.505276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:13.507206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:13.601603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 176/349] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:13.602985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.631575 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64c603-ba5a-447c-a256-dd5df48d0b35 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:13.671909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:13.672933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.673214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.673487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.721568 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586f71-b283-4828-93bb-f40747a3ba51 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:13.760800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:13.762543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:13.764400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:13.765171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.765456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.765733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.766542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:13.766893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:13.768312 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222efa5-2d2d-4f87-b10d-e86046363c56 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:13.778637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 177/350] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:13.780504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:13.780504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:13.780504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:13.799304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:13.800516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:13.884694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 178/351] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:13.886466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:13.890759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 174/352] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:13.891875 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.012156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db5cdb-8868-48ce-bf17-36a68a44ff26 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.014703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129b725-bb41-4d8a-9333-b014c09e8367 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.050154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.050977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.051253 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.051527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.056164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.059369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.059369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.059369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.060509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.061986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6147e3-b248-4664-87a4-90051fd5d63c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.063806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 179/353] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.065024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa9d4-d055-4fb4-b6ae-4a30d7bd421c None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.065309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa9d4-d055-4fb4-b6ae-4a30d7bd421c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.065584 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aa9d4-d055-4fb4-b6ae-4a30d7bd421c None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.067091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 180/354] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:14.067625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aa9d4-d055-4fb4-b6ae-4a30d7bd421c None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.068156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:14.076617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:14.077544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:14.078531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:14.080609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 175/355] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:14.081584 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.187648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aa9d4-d055-4fb4-b6ae-4a30d7bd421c None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.200149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c1034-9ead-4be4-a6d5-26f8b17b6b55 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.225985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.226881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.227169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.227445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] PATH_INFO: `/v3/users/fe6573d529cf499fa7355ff7f04a5a44` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.229199 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] RBAC: Authorizing `identity:get_user(user_id=fe6573d529cf499fa7355ff7f04a5a44)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.230925 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.232592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 181/356] 10.222.0.44 () {56 vars in 1177 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/users/fe6573d529cf499fa7355ff7f04a5a44 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.233360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.238303 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.239195 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.239474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.239744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.241078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.242649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.245060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 176/357] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.249612 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.342676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3138d-bf68-43ae-99e6-94733a72416c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.366007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bf13b-fbcf-4bd3-a339-c5ae6c2b224d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.379169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.379990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.380274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.380552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.395147 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-db96af54-8fb4-4e3c-8d01-5a7b031c8564 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:14.403686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:14.404752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:14.405626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 182/358] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:14.406331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.406627 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.406853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.411339 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.412514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.412815 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.413086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.420144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.421634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.423375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 177/359] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.424145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.428016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:14.429306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:14.510929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 183/360] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:14.514242 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.540990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4565d6-05cf-4fab-841e-b9b95b6da093 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.582072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.583782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.583782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.583782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.584056 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:14.584367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.585749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.595406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 178/361] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.596258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.637738 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b1a31-047e-4fe5-b86d-b5a5804f354f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.674822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.675487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.676364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.676364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.677985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] RBAC: Adding query filter params (role.id=496b8e068e2f4068879475b6d41ffc56, user.id=fe6573d529cf499fa7355ff7f04a5a44, scope.system=all) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:14.677985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.679700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.694804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 184/362] 10.222.0.44 () {56 vars in 1308 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/role_assignments?user.id=fe6573d529cf499fa7355ff7f04a5a44&scope.system=all&role.id=496b8e068e2f4068879475b6d41ffc56 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.695091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.729306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b0100-e925-4961-81eb-17bde154f9de None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.779312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.780214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.780500 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.780783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.782154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.784297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.785901 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 179/363] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.786886 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.833331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d687-ec2c-478b-99af-cd83144782df None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.874981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.878545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.878545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.878545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.878545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:14.878545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.879689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.893908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 185/364] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.893908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:14.905905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7aa3d-df41-46f8-83f0-3ca32099d082 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:14.944439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:14.944639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:14.944910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:14.945182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:14.945995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:14.946363 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:14.948419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:14.955533 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 180/365] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:14.955967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.016739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a91d1-b99e-4b42-991b-1c52566aaa84 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.067924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.069687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.070290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.071003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.089031 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:15.090304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47fdb3-fbde-44d3-8677-f776270b4514 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:15.098477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:15.099621 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 186/366] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:15.100822 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.143066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.143672 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.143914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.144185 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.232552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.233454 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc9c1-a1cf-414b-a95d-8222210c53d1 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.234034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.268435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.269094 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.269392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.269643 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.270766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:15.270875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.272231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.278815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 187/367] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:15.280387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.349466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 181/368] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:15.349466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.401132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429cfeb-23eb-4a2d-9215-a36876916e29 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.440418 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.441554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.441990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.442441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.455665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfce111-fc05-4682-b416-aa7dfef38e43 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.496891 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.497734 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.498163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.498681 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.499526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:15.499933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.501416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.510902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 182/369] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:15.511866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.519107 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.520792 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.614145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588c1f-416b-487e-9fdc-fb992c240ee3 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.628571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 188/370] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:15.629697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.649490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.650589 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.651004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.651437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.652771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.654501 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.660832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 183/371] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:15.660832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.740316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5fb0-a26f-461f-8561-16c59a6be417 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.766470 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c328-8dcc-4843-bedb-786c1680e41c None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.777408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.778400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.778831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.779275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.802514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.803508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.803861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.804210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.805957 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.808524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.814243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 184/372] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:15.814243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.861340 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.862889 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.940149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7e429-0ff1-49a1-bb46-5743ded4501b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:15.973927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 189/373] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:15.974913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:15.977037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:15.978508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:15.979135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:15.979626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:15.981059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:15.982776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:15.989743 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 185/374] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:15.990962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:16.091117 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6b91d-6c2c-4a15-978b-1c739d4e698e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.097870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865c5d-f250-454a-88a8-36ed9ab17dcd None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.128557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.129461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.129746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.130020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.131507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.132733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.139679 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 190/375] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:16.139679 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:16.142273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.143375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.143863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.144363 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] PATH_INFO: `/v3/projects/117739cb2486406297165f39ae144b9a` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.145855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=117739cb2486406297165f39ae144b9a)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.147627 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.149878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 186/376] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:15 2022] GET /identity/v3/projects/117739cb2486406297165f39ae144b9a => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:16.151676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:16.254420 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887640c8-97c7-4322-9c01-2c18e6b50116 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.274684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4c09d-621e-4b6f-8cbd-979a152be5a5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.288417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.289072 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.289355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.289669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.290549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:16.292292 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.293782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.299923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 191/377] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:16 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:16.300554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:16.315494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.316162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.316443 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.316879 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.318143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:16.318490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.320379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.329384 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 187/378] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:16 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:16.419015 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a85cb1-fb82-4fed-b0c4-9d3a2eac86d0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.459300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.460178 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.460460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.460736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] PATH_INFO: `/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.467668 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] RBAC: Authorizing `identity:get_group(group_id=bf0e212d126e4b8fb1b62d74ebf25c1e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.469206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e268c-b41a-43e4-a3db-4db6cf173fcf None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.471196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 192/379] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:16 2022] GET /identity/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:16.477133 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:16.637383 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37911bb7-af08-44e0-a656-bafaeecd0733 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:16.676068 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:16.676769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:16.677053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:16.677380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:16.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] RBAC: Adding query filter params (group.id=bf0e212d126e4b8fb1b62d74ebf25c1e, role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=117739cb2486406297165f39ae144b9a) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:16.678569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:16.680018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cdbe7-0ae0-4c08-a948-706bb03036ef None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:16.687192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 188/380] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:16 2022] GET /identity/v3/role_assignments?group.id=bf0e212d126e4b8fb1b62d74ebf25c1e&scope.project.id=117739cb2486406297165f39ae144b9a&role.id=5067df1fd41e4852bda05f53294ab802 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:17.427797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ddac3-2e8a-424d-ad3e-c844aa73d14b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.428968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ddac3-2e8a-424d-ad3e-c844aa73d14b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.429444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ddac3-2e8a-424d-ad3e-c844aa73d14b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.431032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 193/381] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:17.437874 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.438461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.438969 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.456837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:17.458406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:17.538265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 189/382] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:17.557364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ddac3-2e8a-424d-ad3e-c844aa73d14b None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:17.667392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ddac3-2e8a-424d-ad3e-c844aa73d14b None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:17.705078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:17.706220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.706705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.707186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.719036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-cf5893bf-d06f-49f7-9932-adc101cf3c12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:17.727169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:17.728096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:17.729251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:17.736419 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 194/383] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:17.738023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:17.827599 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba08c-b2e0-4053-ae8c-217324106be3 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.828214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba08c-b2e0-4053-ae8c-217324106be3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.828698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ba08c-b2e0-4053-ae8c-217324106be3 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.830275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 195/384] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:17.835329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.835973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.836450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.856788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:17.857565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3392f-dd1c-4a35-b8f1-39de295ab549 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:17.858545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:17.935491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:17.936311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 196/385] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:17.936522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:17.937036 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:17.937325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:17.941724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] RBAC: Adding query filter params (name=member) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:17.941724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:17.941724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:17.951923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 190/386] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:17.959070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:17.969591 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.067059 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e260ef-d878-4da0-bfc1-b54fb32c9b56 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.102163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.103063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.103413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.104212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.105480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.106994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.109034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 197/387] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:17 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:18.113943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.194015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f22461-01b2-4e13-9cf9-4c29307968fb None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.225486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027910-6ad8-4a7a-bc87-959dab9cea6b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.262835 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.263811 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.264097 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.264375 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.265578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.267365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.269550 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 198/388] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:18 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:18.274886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.284263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.285077 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.285353 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.285624 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.320509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:18.328722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:18.329608 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:18.331052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 191/389] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:18.339132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.452881 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a35ce-03a0-49ee-8fb7-29b913296d9e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.460724 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff9a9-c02c-4af5-babb-291b21ed4c76 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.497612 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.498227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.498510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.498787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.499535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:18.499840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.507214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.524379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 192/390] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:18.532494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.535825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.537808 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.538722 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.540017 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/groups/db6e3a89615440459f00353d6bcd0364/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.545208 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, group_id=db6e3a89615440459f00353d6bcd0364, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.548179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.642414 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 199/391] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 12 16:39:18 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/groups/db6e3a89615440459f00353d6bcd0364/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:18.667062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805208a-2f3a-40cb-9dc0-24a8cece6354 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.718786 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.720013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.720471 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.720919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.722568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.724312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.726419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 193/392] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:18 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:18.733163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:18.859518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62551b2-0070-4afb-a1ff-bea5fe75cd0a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:18.900452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:18.901282 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:18.901566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:18.901840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:18.903147 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:18.904633 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f694685-faa6-4554-b5ae-507b6b1961a8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:18.906542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 200/393] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:18 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:18.912740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:19.039643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a8b90-6185-4138-9b9c-986c734aa7d0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:19.091038 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:19.092365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.092857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.093358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/groups/db6e3a89615440459f00353d6bcd0364/roles/c0065defbccb49c69fbc0e7b8de85e36` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.098987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c831a5a11426b9e786f8fc13a9994, group_id=db6e3a89615440459f00353d6bcd0364, role_id=c0065defbccb49c69fbc0e7b8de85e36)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:19.100867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5e9b-01fd-46b5-a19e-0a37139454d3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:19.207829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 194/394] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 12 16:39:18 2022] PUT /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994/groups/db6e3a89615440459f00353d6bcd0364/roles/c0065defbccb49c69fbc0e7b8de85e36 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:19.300285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849122-804d-459f-b513-7d8256fca6b8 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.300943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849122-804d-459f-b513-7d8256fca6b8 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.301425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca849122-804d-459f-b513-7d8256fca6b8 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.303386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 201/395] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:19.310344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.310955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.311451 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.336503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:19.338753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:19.347457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723ed93-b434-4833-96d9-4a79dc969d60 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.348108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723ed93-b434-4833-96d9-4a79dc969d60 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.348614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723ed93-b434-4833-96d9-4a79dc969d60 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.350334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 202/396] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:19.356526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.357183 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.357624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.392299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:19.393523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:19.474532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 195/397] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:19.500284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:19.526476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 203/398] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:19.569111 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:19.662324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc8778-8f72-4d85-b376-7942ce441f53 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:19.700041 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a82ea-56fc-4492-8689-22827cfd7558 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:19.747069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:19.747791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.748071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.748345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.750874 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:19.751678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.751956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.752232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.773152 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:19.781665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:19.782589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:19.783361 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:19.783950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:19.791795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:19.793762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:19.795654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:19.797073 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 204/399] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:19.797210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 196/400] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:19.800082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:19.800820 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:19.933558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c783e86-bd10-4eff-9e51-2c1d65e617aa None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:19.941786 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380d5d-006a-4f5c-8336-f2a65f289713 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:19.977322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:19.978011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:19.979259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.979367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.979802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.979901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.980322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.980512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.981413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:19.981615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:19.982052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:19.982161 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:19.983577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:19.983912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5b10-28c3-41e0-8e07-47bdfd59808b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:19.995343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 197/401] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:19.997024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1c4c-1b91-4e53-83ae-8b74e97bed8c None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:19.997576 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1c4c-1b91-4e53-83ae-8b74e97bed8c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:19.998060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1c4c-1b91-4e53-83ae-8b74e97bed8c None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:19.999769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 198/402] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:20.006236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 205/403] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:20.007330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1c4c-1b91-4e53-83ae-8b74e97bed8c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.007588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.125279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1c4c-1b91-4e53-83ae-8b74e97bed8c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.157054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a5254-a712-45fe-8450-520a4620f678 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.160439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.161465 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.161914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.162427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.163738 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.166370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f5b43-700f-4d52-8156-3674917b1853 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.173367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 199/404] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:20.173367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.173367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.173367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.193501 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:20.195164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:20.201327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.202568 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.203053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.203575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.205006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.206825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.209043 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 206/405] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:20.210162 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.265302 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 200/406] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:20.266223 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.322693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcd68c-3a10-476e-850f-365ba14706b4 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.365197 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.366504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621aec4-e7b3-4a51-aa00-9a7c15831f2d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.367035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.367704 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.368524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.372373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.375059 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.378487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 207/407] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:20.379538 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.407215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.408169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.408603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.409004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.410224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.411865 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.414019 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 201/408] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:20.414963 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.496108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de193795-2de6-41ed-8e58-937aea062c41 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.532793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eff9fe-ae2e-4989-af5e-52107c5004ae None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.533663 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.535933 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.536403 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.536856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.550407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:20.561565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:20.562577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:20.563373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:20.563968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 208/409] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:20.565293 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.575153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.576043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.576326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.576601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/groups/db6e3a89615440459f00353d6bcd0364/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.580159 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, group_id=db6e3a89615440459f00353d6bcd0364, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.581997 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.675398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93a14-28ec-4732-ab8c-8740ca908d7c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.710181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.711070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.711347 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.711618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/groups/db6e3a89615440459f00353d6bcd0364/roles/c0065defbccb49c69fbc0e7b8de85e36` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.714634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac0eb3d2efdb449fb11aa90fa5338de3, group_id=db6e3a89615440459f00353d6bcd0364, role_id=c0065defbccb49c69fbc0e7b8de85e36)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.716350 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.733827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 202/410] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 12 16:39:20 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/groups/db6e3a89615440459f00353d6bcd0364/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:20.735196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:20.803898 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 209/411] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 12 16:39:20 2022] PUT /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3/groups/db6e3a89615440459f00353d6bcd0364/roles/c0065defbccb49c69fbc0e7b8de85e36 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:20.870001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed93a-c11d-4fd1-aa6f-bc7962e861e4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:20.910245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:20.910948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:20.911228 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:20.911503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:20.912261 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:20.912629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:20.914182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:20.925671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 203/412] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:20.931289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.063272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcba327-2c1d-4eda-a56f-22f14d2c0621 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:21.100272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:21.101184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.101471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.101749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] PATH_INFO: `/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.102953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0e212d126e4b8fb1b62d74ebf25c1e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:21.105300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:21.107395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 210/413] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:20 2022] GET /identity/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:21.112876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.222823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451198a5-df24-4442-b016-a996c45ee639 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:21.261760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:21.262652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.262933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.263208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] PATH_INFO: `/v3/projects/117739cb2486406297165f39ae144b9a` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.264400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] RBAC: Authorizing `identity:get_project(project_id=117739cb2486406297165f39ae144b9a)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:21.265827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e56a0-8998-4fec-8320-dde4eac917d2 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:21.267572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 204/414] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:21 2022] GET /identity/v3/projects/117739cb2486406297165f39ae144b9a => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:21.273462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.370975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420f68-95fb-4c9b-8225-b60409de926a None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.371532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420f68-95fb-4c9b-8225-b60409de926a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.371987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420f68-95fb-4c9b-8225-b60409de926a None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.373822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 205/415] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:21.379671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.389647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.389647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.408819 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:21.413825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:21.432976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38fec4-4785-4ccc-b154-c10e50157e37 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:21.469057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:21.470263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.470721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.471156 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] PATH_INFO: `/v3/projects/117739cb2486406297165f39ae144b9a/groups/bf0e212d126e4b8fb1b62d74ebf25c1e/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.481266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=117739cb2486406297165f39ae144b9a, group_id=bf0e212d126e4b8fb1b62d74ebf25c1e, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:21.481266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:21.517045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 206/416] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:21.543756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.624891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 211/417] 10.222.0.44 () {58 vars in 1442 bytes} [Thu May 12 16:39:21 2022] PUT /identity/v3/projects/117739cb2486406297165f39ae144b9a/groups/bf0e212d126e4b8fb1b62d74ebf25c1e/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:21.679747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317eea4-ca62-4dcf-b04b-54da0a6f96d4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:21.743075 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:21.744477 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.744799 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.745117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.763497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:21.771548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:21.772514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:21.773791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 207/418] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:21.779063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.914060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe08422-08bc-4a24-8a33-3caa07ec02d5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:21.951369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:21.952417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.952944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.953437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.954497 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:21.955007 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:21.956583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82181766-ba64-4d04-a9c2-7307bfcfed7a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:21.967886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 212/419] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:21.971324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:21.973834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8f12-26ea-4677-a10e-faa3755eb7d9 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.974391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8f12-26ea-4677-a10e-faa3755eb7d9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.974872 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8f12-26ea-4677-a10e-faa3755eb7d9 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:21.976567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 213/420] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:21.982979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:21.983268 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:21.983549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.009227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:22.011996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:22.127422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 214/421] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:22.142583 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fcc85-f06b-4b24-9a75-2b6ddcb2f199 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.183114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:22.183820 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:22.184110 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:22.184389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.215552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:22.327325 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1fbff-f639-4ac4-8a82-9afed192f76f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.335487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:22.336990 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:22.388084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:22.388819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:22.389105 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:22.389382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.412797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:22.421755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:22.422752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:22.423943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 215/422] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:22.435556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:22.552179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895a94-845c-4dab-b7c7-fded123f8a4a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.581364 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 208/423] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:39:22.586162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:22.590928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:22.591861 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:22.592347 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:22.592847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.593796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:22.594355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:22.596810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:22.606921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 216/424] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:22.612422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:22.718168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc35cf-4fc4-4e1a-981f-f2e90b8c913e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.765492 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:22.766425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:22.766752 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:22.767040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.770948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:22.772425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:22.774452 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 209/425] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:22 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:22.782008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:22.803281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967cae-c73d-4515-b6e1-2febdcbffdde None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.839862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:22.840516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:22.840801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:22.841083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:22.936174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7c2f3-d9f1-4fe8-8817-4005c406deec None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:22.982903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:22.985796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.003541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:23.005135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.005643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.006121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.008666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:23.011491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.016355 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 210/426] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:22 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:23.020439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.151783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f92-8070-4c1f-bf7e-de112aaa868a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:23.187402 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:23.188422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.188928 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.189400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.190465 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:23.190995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:23.192642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.199549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 211/427] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:23.213511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 217/428] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:23.218804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.338837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caf426-0a4e-4a0b-8361-210b42640b93 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:23.396562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:23.397438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.397725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.398005 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] PATH_INFO: `/v3/projects/1a8c831a5a11426b9e786f8fc13a9994` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.403062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] RBAC: Authorizing `identity:get_project(project_id=1a8c831a5a11426b9e786f8fc13a9994)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:23.404819 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.406661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 212/429] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/projects/1a8c831a5a11426b9e786f8fc13a9994 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:23.412118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.538113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37577-f9e6-4801-a4be-bebc74b21c3a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:23.589806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:23.590676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.590952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.591223 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.592426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:23.593956 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2d1dd-3492-4545-a419-c368f836c097 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.595765 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 218/430] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:23.602387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.672095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c551fb-62a4-4619-8efd-425efe6f164e None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.672424 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c551fb-62a4-4619-8efd-425efe6f164e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.672656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c551fb-62a4-4619-8efd-425efe6f164e None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.674145 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 219/431] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:23.680691 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7aaa-5016-4418-ab63-ee9178ed9560 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.680977 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7aaa-5016-4418-ab63-ee9178ed9560 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.681334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7aaa-5016-4418-ab63-ee9178ed9560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.710656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-077a7aaa-5016-4418-ab63-ee9178ed9560 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:23.711598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-077a7aaa-5016-4418-ab63-ee9178ed9560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:23.742567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116100c-e68d-4afe-848e-ac01f8e6d367 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:23.781129 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:23.782168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.782729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.783128 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.783941 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=1a8c831a5a11426b9e786f8fc13a9994) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:23.784251 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:23.785697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd15700-b226-4c18-bc4e-14e1e83139bf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:23.793574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 213/432] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=1a8c831a5a11426b9e786f8fc13a9994&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:23.794873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec2b0-d22d-483b-9d16-daa7b80f175d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.795166 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec2b0-d22d-483b-9d16-daa7b80f175d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.795327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 220/433] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:23.795447 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec2b0-d22d-483b-9d16-daa7b80f175d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.796658 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 214/434] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:23.802498 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:23.802843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:23.803188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:23.822078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec2b0-d22d-483b-9d16-daa7b80f175d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.822323 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:23.823996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:23.929728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 221/435] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:23.957780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:23.959031 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec2b0-d22d-483b-9d16-daa7b80f175d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.007152 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.008621 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.008909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.009188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.026907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:24.037878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:24.039388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:24.040224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 215/436] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:24.045598 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.112614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3f4e1-e82f-4b68-9071-f27a1e5eb55a None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.164239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.164957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.165236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.165506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.182543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544694-3888-489d-9bf3-e8fd14cac8dd None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.183983 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:24.192245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:24.193151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:24.193940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 222/437] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:24.200471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.222931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.223890 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.224597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.225010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.225900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:24.226394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.228601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.238321 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 216/438] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:24.244340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.325402 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2318-9899-4dd3-959c-bb7ca13631a8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.372684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecb30-b1a1-4f09-a9dd-a6a68ff9b7a4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.372903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.373534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.373817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.374095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.374948 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] RBAC: Adding query filter params (name=member) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:24.375258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.376646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.385903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 223/439] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:24.391404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.409662 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.410349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.410632 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.410906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.477300 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.479115 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ba53f-8474-469f-81fb-e97aa7f7b114 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.491505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8eec-ad15-4abd-aad4-32f612902905 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.524346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.525663 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.525949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.526254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.574056 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 217/440] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:39:24.575422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406d5d-3d68-4512-97c8-cb624d933d3e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.575706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406d5d-3d68-4512-97c8-cb624d933d3e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.575980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406d5d-3d68-4512-97c8-cb624d933d3e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.577519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 218/441] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:24.579782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406d5d-3d68-4512-97c8-cb624d933d3e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.591479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.592964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdd931-c48b-464e-9493-6a7cd79726cf None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.679163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406d5d-3d68-4512-97c8-cb624d933d3e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.688696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 224/442] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:24.690560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.690560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.690560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.706731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:24.707913 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:24.713156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.714462 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.714746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.715023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.716203 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.717638 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.719353 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 219/443] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:24.720137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.774864 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 225/444] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:24.775703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.818178 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d62bc-cfb5-44c1-b073-19b72bf99403 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.851666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.852518 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.852799 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.853129 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] PATH_INFO: `/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.854465 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] RBAC: Authorizing `identity:get_project(project_id=ac0eb3d2efdb449fb11aa90fa5338de3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.855909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.857601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 220/445] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/projects/ac0eb3d2efdb449fb11aa90fa5338de3 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:24.858495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.873918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80e75-8656-4caa-a1de-973d8dbe7735 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.907601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.908444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.908725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.909000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:24.910165 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:24.911644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:24.913244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 226/446] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:24.914001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:24.960522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e39bf-0bc4-4fcf-9363-065f10ed37d7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:24.992555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:24.993348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:24.993630 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:24.994481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.008878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28740047-6a0c-46a2-995d-275ec2dd059e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.010221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:25.019074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:25.020145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:25.021119 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 221/447] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:25.021789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.051763 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.052540 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.052819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.053089 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] PATH_INFO: `/v3/groups/db6e3a89615440459f00353d6bcd0364` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.054344 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] RBAC: Authorizing `identity:get_group(group_id=db6e3a89615440459f00353d6bcd0364)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.055783 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.057461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 227/448] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:24 2022] GET /identity/v3/groups/db6e3a89615440459f00353d6bcd0364 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.058307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.122698 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d146cf1-b20b-42d3-8f19-0b25635db9f5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.155849 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.156504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.156786 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.157074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.157880 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c0065defbccb49c69fbc0e7b8de85e36, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:25.158167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9661-f981-49e7-a669-635844d80dc7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.158304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.159670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.165289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 222/449] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c0065defbccb49c69fbc0e7b8de85e36 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.166125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.194423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.195111 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.195398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.195676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.196452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:25.196763 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.199028 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.208525 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 228/450] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.214946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.278012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bd1b8-41eb-4cac-a2aa-b58f54929866 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.315129 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.315705 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.315988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.316256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.317085 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] RBAC: Adding query filter params (group.id=db6e3a89615440459f00353d6bcd0364, role.id=c9f667508a63410faf255ae6b67c8ffd, scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:25.317397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.318935 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.324249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007db23-4885-45a6-bf56-c5691d7ac5a4 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.327015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 223/451] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/role_assignments?group.id=db6e3a89615440459f00353d6bcd0364&scope.project.id=ac0eb3d2efdb449fb11aa90fa5338de3&role.id=c9f667508a63410faf255ae6b67c8ffd => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.367986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.368650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.370029 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.370398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.452578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.454072 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.555047 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 229/452] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:39:25.560917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.662863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466011c-a1f4-4249-884f-96c8ee054acf None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.702331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.703097 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.703424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.703702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] PATH_INFO: `/v3/projects/117739cb2486406297165f39ae144b9a` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.705549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] RBAC: Authorizing `identity:get_project(project_id=117739cb2486406297165f39ae144b9a)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.707161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.709917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 224/453] 10.222.0.44 () {56 vars in 1186 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/projects/117739cb2486406297165f39ae144b9a => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.716990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.822297 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e49563-ebde-4245-8a10-e213e0dc5d64 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.857216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.858059 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.858376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.858654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] PATH_INFO: `/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:25.859849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0e212d126e4b8fb1b62d74ebf25c1e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:25.861284 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb95f76-8113-4f28-a3f2-e2c73ac37a70 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:25.862957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 230/454] 10.222.0.44 () {56 vars in 1180 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/groups/bf0e212d126e4b8fb1b62d74ebf25c1e => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:25.868837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:25.966979 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49451d80-8e37-4416-a273-4de482a6d5fd None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:25.998572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:25.999216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:25.999503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:25.999778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:26.000597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] RBAC: Adding query filter params (group.id=bf0e212d126e4b8fb1b62d74ebf25c1e, role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=117739cb2486406297165f39ae144b9a) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:26.000984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:26.002427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356a4ac-2b87-4f8e-8141-4bb27091e9b0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:26.008321 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 225/455] 10.222.0.44 () {56 vars in 1376 bytes} [Thu May 12 16:39:25 2022] GET /identity/v3/role_assignments?group.id=bf0e212d126e4b8fb1b62d74ebf25c1e&scope.project.id=117739cb2486406297165f39ae144b9a&role.id=5067df1fd41e4852bda05f53294ab802 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:28.691929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100702-3654-4135-bcfb-0df0a0fc453b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:28.692447 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100702-3654-4135-bcfb-0df0a0fc453b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:28.692523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100702-3654-4135-bcfb-0df0a0fc453b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:28.693838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 231/456] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:28.702909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02377d-5fcf-4744-b1f1-680b4ad79418 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:28.703836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02377d-5fcf-4744-b1f1-680b4ad79418 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:28.705163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02377d-5fcf-4744-b1f1-680b4ad79418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:28.733504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-2d02377d-5fcf-4744-b1f1-680b4ad79418 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:28.735182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-2d02377d-5fcf-4744-b1f1-680b4ad79418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:28.810642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 226/457] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:28.828732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e2ad-3d66-470a-ba75-fab19f414d4b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:28.829368 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e2ad-3d66-470a-ba75-fab19f414d4b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:28.829845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e2ad-3d66-470a-ba75-fab19f414d4b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:28.831445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 232/458] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:28.836503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e2ad-3d66-470a-ba75-fab19f414d4b None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:28.842245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:28.842245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:28.842245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:28.855316 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:28.856499 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:28.942299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 227/459] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:28.951856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e2ad-3d66-470a-ba75-fab19f414d4b None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:28.960850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:28.992917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:28.995199 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:28.995549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:28.995825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.008104 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.010560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-39c41149-bee1-4dc4-b1d9-81803404848f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:29.033790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:29.034908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:29.036275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:29.036275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:29.036275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.036275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:29.036275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 233/460] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:29.038524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd91a-1ca8-4d84-884a-c2af019097f9 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.038524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd91a-1ca8-4d84-884a-c2af019097f9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.038524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd91a-1ca8-4d84-884a-c2af019097f9 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.043772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 234/461] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:29.043772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd91a-1ca8-4d84-884a-c2af019097f9 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.065615 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38d00-4ea1-4002-baf9-cb767b77946c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.108088 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.108906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.109184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.109454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.125290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.127488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-7eed709f-6d08-4174-92e8-c8406d821424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:29.147116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:29.148023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:29.148902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:29.148902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:29.148902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.148902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:29.148902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 228/462] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:29.150014 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.150375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.150702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.163531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd91a-1ca8-4d84-884a-c2af019097f9 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.168091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:29.169268 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:29.200905 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.201476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.201762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.202043 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.202801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:29.203110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.204503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.220752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 235/463] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:29.220752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.246231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 229/464] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:29.246231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.316377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf05c-485f-44d2-8574-915f22b1a767 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.348676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267a48f-1079-42df-9fed-7101f9c4b84f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.348902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.349466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.349741 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.350018 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.350768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:29.351127 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.352433 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.364812 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 236/465] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:29.365645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.384974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.385649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.385931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.386323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.386949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.388441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbacf5e-c13b-4552-895a-ba36bb11251b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.460855 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597768a-64cf-4d45-a5bd-8ff10d0076d8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.492918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.497682 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.497682 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.497682 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.497931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 230/466] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:39:29 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:29.498653 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2f189-9c2e-4ea5-8084-21e0e091e36d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.498942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2f189-9c2e-4ea5-8084-21e0e091e36d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.499245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2f189-9c2e-4ea5-8084-21e0e091e36d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.500641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 231/467] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:29.501223 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2f189-9c2e-4ea5-8084-21e0e091e36d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.511493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.512997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-3b648e90-f417-4699-bac0-bf75b0cd205e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:29.532923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:29.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 237/468] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.539714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.556702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:29.560819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:29.622095 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2f189-9c2e-4ea5-8084-21e0e091e36d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.633223 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 238/469] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:29.634564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.669215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.669860 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.670131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.670445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.671157 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.672627 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.762188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99307c-22f9-4778-a577-6e20fc183826 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.796563 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.797228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.797511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.797788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.798538 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:29.798845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.800224 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:29.812306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 239/470] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:29.818263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.818395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 232/471] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:39:29 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:29.818395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:29.948675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3a7c-6d33-408a-97de-458001e9b8f3 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.950898 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f9f2-9374-41af-848b-f217ae002230 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:29.988951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.990321 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:29.990937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.991135 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:29.991411 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.991687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.992169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:29.992644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:29.994106 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:29.995984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:30.004217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:30.005693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:30.025499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:30.026530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:30.027372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:30.027372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:30.027372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:30.027372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:30.027372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 240/472] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:30.032421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:30.147530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711cd7-5922-47dc-9c27-86c0f87afe05 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:30.183360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 233/473] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:39:29 2022] POST /identity/v3/users => generated 248 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:30.189022 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:30.190279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:30.190885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:30.192845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:30.192845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:30.192845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:30.194318 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2e8c-71d3-45dc-8655-098e87073b48 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:30.209892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 241/474] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:30.217558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:30.335271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dd6d9-accd-4f58-9026-2dc7cfc9cf8c None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:30.373143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:30.373830 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:30.374113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:30.374415 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:30.375118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:30.376577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c4cb-241a-4918-b2d8-876fdb6674fe None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:30.474872 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 234/475] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:39:30 2022] POST /identity/v3/users => generated 249 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:31.927095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5c5d-557a-41fb-a646-ddfe2cf59644 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:31.927676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5c5d-557a-41fb-a646-ddfe2cf59644 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:31.927676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d5c5d-557a-41fb-a646-ddfe2cf59644 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:31.929258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 242/476] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:31.934689 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:31.935166 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:31.935335 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:31.952808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:31.954016 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:32.026535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 235/477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:32.047984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5c5d-557a-41fb-a646-ddfe2cf59644 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.165292 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d5c5d-557a-41fb-a646-ddfe2cf59644 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.200787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.201576 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.201857 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.202128 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.212794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-0d014d9b-69b7-4776-b7e5-f842bf0d27db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:32.220642 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:32.222826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:32.224784 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 243/478] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:32.229992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.260461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f2e0-96d3-4d78-ab41-fe04fb737668 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.260982 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f2e0-96d3-4d78-ab41-fe04fb737668 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.261476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f2e0-96d3-4d78-ab41-fe04fb737668 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.264440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 244/479] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:32.272089 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.272451 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.272648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.294626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:32.296006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:32.337819 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b89f3-c893-4020-aa85-025e94cf42e5 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.374477 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.375282 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.375629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.376008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.376863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:32.377240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:32.379006 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:32.382904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 245/480] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:32.396883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 236/481] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:32.402234 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.416564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.510137 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e079602-357a-4937-8fed-0fbf1dce6a79 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.521183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8436d-8a2b-43bb-8be6-ec2e9b4d497a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.545176 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.545970 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.546281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.546562 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.554819 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.555613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.555900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.556719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.558900 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:32.560827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:32.567232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:32.575748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:32.577827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:32.579905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:32.581313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:32.584521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:32.594507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:32.594507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:32.594507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:32.594507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:32.594983 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 237/482] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:32.594983 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.595258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 246/483] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:32.595258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.693510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9399-c057-4476-ad3c-8b5ad122da10 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.713143 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2178a-b6ab-4eef-b51b-df314a0d45a3 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.738732 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.739847 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.740144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.740404 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.741169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:32.741473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:32.742877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fc53-04d1-48c8-8b2e-518028e3e7ee None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:32.751065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 238/484] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:32.756096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.756887 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59580a-7ec9-4388-a774-b8dcd7259306 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.757173 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59580a-7ec9-4388-a774-b8dcd7259306 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.757270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.757452 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59580a-7ec9-4388-a774-b8dcd7259306 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.757696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.758187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.758866 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 239/485] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:32.759968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59580a-7ec9-4388-a774-b8dcd7259306 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.766051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:32.766635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:32.769314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08965fb-788f-4886-9c64-9cd2366954dd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:32.791543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 247/486] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:32.791543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.791543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.791543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.807677 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:32.808856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:32.879998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 248/487] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:32.880961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.893045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59580a-7ec9-4388-a774-b8dcd7259306 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:32.929313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:32.930121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:32.930440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:32.930711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:32.941025 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:32.942529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:32.959835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:32.960729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:32.961582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:32.961582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:32.961582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:32.961582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:32.961582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 240/488] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:32.963326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:32.981333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab27c-99fc-4b09-9c03-d2cca058d19b None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.014920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037613-161f-4180-8391-a9676204a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.015714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037613-161f-4180-8391-a9676204a14e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.015991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037613-161f-4180-8391-a9676204a14e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.016267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037613-161f-4180-8391-a9676204a14e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.023453 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037613-161f-4180-8391-a9676204a14e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.024876 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037613-161f-4180-8391-a9676204a14e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-f3037613-161f-4180-8391-a9676204a14e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:33.040099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:33.041184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:33.042088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 249/489] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:33.042965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7d6-c7b8-4fbf-8333-ada1dde0a4c1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.042965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7d6-c7b8-4fbf-8333-ada1dde0a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.043098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7d6-c7b8-4fbf-8333-ada1dde0a4c1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.047972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 250/490] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:33.047972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca7d6-c7b8-4fbf-8333-ada1dde0a4c1 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.058374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544f10-b41c-4e23-a3e3-03df773b8cbc None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.091225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.092015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.092297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.092601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.106216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:33.114051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:33.115030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 241/491] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:33.116391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.149369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca7d6-c7b8-4fbf-8333-ada1dde0a4c1 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.183810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.184462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.184745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.185019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.185740 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:33.186043 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.187462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d98047-faad-4032-a65f-eb3b5f90b29c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.199154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 251/492] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:33.200664 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.200952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.201230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.217373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:33.218537 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:33.221003 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac876df-d2b6-4e4d-813a-03c4e313781d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.253882 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.254588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.254871 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.255147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.255978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:33.256288 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.257729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.284436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 252/493] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:33.285291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.295769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 242/494] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:33.296657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.382750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8155a-348b-42ce-ac1b-a8eb48451b6c None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.392388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae2d78-ace4-4e91-bfca-4620bd96fb0b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.416248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.416909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.417189 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.417459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.418257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:33.418563 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.419929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.425597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.426413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.426697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.426976 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.427706 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 253/495] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:33.428511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.434929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.436458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:33.452796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:33.453767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:33.454728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 243/496] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:33.455639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.531671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6550-17f2-4b68-b8a2-ce99df9b6573 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.551183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa752e5-a3c7-4efe-91d8-c9f8e811bbd4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.562846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.563515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.563801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.564075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.585071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.585854 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.586140 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.586459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.597129 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:33.605067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:33.605970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:33.606938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 244/497] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:33.607604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.633187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.635206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.704579 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7683f-3e78-4d8d-b0e8-793b6b2f7329 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.735892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 254/498] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:33.736750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.740787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.741593 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.741873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.742144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.753756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.755254 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:33.771944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:33.773046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:33.774107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:33.774107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:33.774107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:33.774107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:33.778538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 245/499] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:33.779477 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.832372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67318c-1c63-4d02-9553-e016acdd007d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.865713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.866410 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.866704 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.866962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.867787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:33.868092 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.869544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.877676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b575c-d5f0-4146-a086-a2a2a26aec71 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:33.907373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 255/500] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:33.908217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:33.911459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:33.912324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:33.912607 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:33.912883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:33.913638 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:33.913944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:33.915953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:33.924541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 246/501] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:33.925283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.003925 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400771e1-cc64-42d1-8828-81df1796f5aa None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.020199 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e6dcc-0800-4ed4-8d6c-34677c55dc68 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.041811 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.042619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.042906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.043185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.053104 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.053656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.053756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.054021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.054326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.055044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:34.055131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.055352 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.056768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:34.072832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.078660 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.079606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:34.079606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:34.079606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.079606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:34.079606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 256/503] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.079895 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 247/503] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:34.079967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.080042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.169609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23f4b-f3de-4c61-a880-f2c9eac74537 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.176346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ae6af-18fb-44c2-838a-89e5191ee18a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.202601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.203382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.203662 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.203935 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.209154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.209819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.210101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.210402 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.214453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.215922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:34.233482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.234458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 248/504] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.240069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.277119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.279435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.331644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438b37f-ba45-4e49-b32f-b8960a8e55a0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.363836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.364616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.364907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.365163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.372154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.373606 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.376229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 257/505] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:34.377078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:34.389938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.391073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 249/506] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.392070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.483237 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390661b-7d1f-48cc-831e-c91cc18c58b5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.489973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a1cd-d27f-4dd2-8602-6be41dcb529b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.518569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.519405 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.519851 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.520200 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.521209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:34.521678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.523224 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.525828 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.526511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.526791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.527063 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.527769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:34.528071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.529420 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.534570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 258/507] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:34.535365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.541304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 250/508] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:34.542147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.636619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef2092-7037-4a16-bf18-f4ccad17b545 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.636865 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d76db5-c39e-4242-88a0-29d4e41be9ea None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.669260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.669610 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.669925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.670233 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.670423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.670515 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.670711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.670990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.671320 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:34.671627 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.673058 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.681173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.682732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.689543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 251/509] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:34.690391 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:34.705521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.706439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.707299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:34.707299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:34.707299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:34.707299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:34.707299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 259/510] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.707568 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.793289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a298b-4f57-45e0-9c49-4f1440851591 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.811578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17c3-4752-486c-96ea-59345ff7381e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.826059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.826894 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.827196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.827482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.834525 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.836000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.844963 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.845752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.846037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.846356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:34.850927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.851767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:34.852613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 252/511] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.854125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.855413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:34.856862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:34.872397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:34.873255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 260/512] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:34.874934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:34.956743 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ab4b-4d5f-47b0-9745-1d250490dc40 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.971861 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c87534-d32d-44f9-b5d6-87b40036fb85 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:34.988728 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:34.989360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:34.989639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:34.989913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.004833 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.005488 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.005771 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.006048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.006806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.007109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.008462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.020403 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 261/513] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.021218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.058066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.059492 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.121328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859dfba-5c2c-4cc8-945d-057c664e6b15 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.153437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 253/514] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:35.154357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.154484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.155199 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.155482 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.155757 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.156541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.156848 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.158603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.176902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 262/515] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.177734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.249422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a5c2-61ee-4232-92f5-64de591461c9 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.274096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e0b4c-cdb4-497a-a107-2b802cdcbbea None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.281892 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.282580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.282861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.283134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.283957 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.284258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.285724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.303040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 254/516] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.303859 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.307865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.308714 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.308941 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.309215 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.316118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.317582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:35.332142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:35.333470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 263/517] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:35.335106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.406930 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074aeef-abdc-465b-ad70-0faa77e4644d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.435760 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2c79b-690c-406f-a44f-946c0974c07e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.439094 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.439871 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.440148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.440422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.450694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.452177 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.468109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.468752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.469036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:35.469255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:35.470176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:35.471091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:35.471091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:35.471091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:35.471091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:35.471355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.471355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=32e2241ed2ff4f1e935b69e21838908b) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.471355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.471540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 255/518] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:35.471540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.472065 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.477698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 264/519] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/role_assignments?user.id=32e2241ed2ff4f1e935b69e21838908b&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.478653 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.581053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6293-7cb7-4615-af35-5a2e3f660735 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.585557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cde552-ed13-4dea-8e5e-b14028c3f411 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.620141 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.620798 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.621082 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.621357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.622586 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.623257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.623538 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.623834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.624629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.624942 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.626405 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.644722 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 265/520] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.644722 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.703807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.705412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.743816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261b69b-add3-49b5-a274-d9a6f625205d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.780517 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.781185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.781469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.781748 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.782506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.782817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.784184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.800702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 266/521] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.800702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.814715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 256/522] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:35.815746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.905954 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb668-b870-4272-a87e-ebd0603c726e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.924722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32fb26-1a98-4aef-8456-ab87abb7a65e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:35.939846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.940513 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.940781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.941055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.941894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=530a81ba35704a64a07d373ef18b4ab1) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:35.942225 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.943673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.949582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 267/523] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/role_assignments?user.id=530a81ba35704a64a07d373ef18b4ab1&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:35.951220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:35.960775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:35.962459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:35.962459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:35.962459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:35.970528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:35.972154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:35.988453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:35.994876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:35.995746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 257/524] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:35.996204 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.075625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24fc13-07c9-442c-8d72-2a988231de3a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.114031 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.114934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.115176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5d74-c028-41a8-a399-4c65dce406e2 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.115647 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.115647 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.131035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.131035 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:36.151910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:36.153707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:36.155307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:36.155307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:36.155307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:36.155307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:36.155307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 268/525] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:36.155782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.155782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.155782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.155782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.162221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:36.162221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.162221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.162701 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.186299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 258/526] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:36.187933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.279762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3be9d-6d8e-429b-884e-2e6ce9101711 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.326751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.328006 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb32cd6-9dd3-48a5-ac91-285b743fd88c None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.328174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.328725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.329326 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.332110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:36.332434 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.334148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.349106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 269/527] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:36.355684 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.375832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.376597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.376973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.377317 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.378553 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=c91e736aa84b449bb0657de099a88ef1) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:36.378936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.380511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.394491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 259/528] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:36 2022] GET /identity/v3/role_assignments?user.id=c91e736aa84b449bb0657de099a88ef1&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:36.471845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1721c-9600-48f8-ab9c-4542527a247a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.512291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.513163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.513456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.513733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.521590 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.523095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:36.540006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:36.541840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:36.544108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 270/529] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:36.547796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.664902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9fc4-d21b-4446-8dcd-40f5b8c0b551 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.699379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.700053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.700510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.700795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.701590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:36.701897 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.703396 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46239213-fd4f-423e-9df0-25e02174badb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.722478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 260/530] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:36.724286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:36.828747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e117-25c2-4b20-9235-bb6dd906f15e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:36.863630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:36.864283 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:36.864566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:36.864841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:36.865669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=defbe1cd07004860a20a4370f03ff612) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:36.865980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:36.867520 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98fbd2-ea90-4cfe-97e6-21495988aada None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:36.874071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 271/531] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:36 2022] GET /identity/v3/role_assignments?user.id=defbe1cd07004860a20a4370f03ff612&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:37.842999 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee669a-0077-43d8-be8d-1d0c97404f58 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:37.843731 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee669a-0077-43d8-be8d-1d0c97404f58 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:37.843731 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee669a-0077-43d8-be8d-1d0c97404f58 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:37.845193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 261/532] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:37.851680 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:37.852108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:37.852427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:37.870163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:37.871387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:37.946309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 272/533] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:37.964995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee669a-0077-43d8-be8d-1d0c97404f58 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.081691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee669a-0077-43d8-be8d-1d0c97404f58 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.120400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.121117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.121398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.121668 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.133273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:38.141474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:38.143748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:38.145787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:38.147364 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 262/534] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:38.151646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.257787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471b11-105a-43bb-8c8c-29acc5b0c6ba None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.293206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.293883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.294164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.294468 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.295217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:38.295522 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:38.296898 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17d82d-fdfd-40b6-98d8-96e985fea9dd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:38.310114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 273/535] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:38.311529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.368850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc8af-a68c-4c66-a7cf-16d594ea9459 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.369252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc8af-a68c-4c66-a7cf-16d594ea9459 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.369566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc8af-a68c-4c66-a7cf-16d594ea9459 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.371282 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 274/536] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:38.377506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.377506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.377506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.396474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:38.397982 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:38.429855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c62b46-8cac-4dcf-9028-1e7fda82ae67 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.474265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.474816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.475099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.475374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.478811 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 275/537] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:38.495499 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:38.497000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:38.498583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:38.519902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:38.520933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:38.521826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:38.521826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:38.521826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:38.521826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:38.526304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 263/538] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:38.528002 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.607633 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46af7c-f23d-4e82-8309-8838a3580fa6 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.655483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.656203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.656483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.656766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.667092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c854a64-cf76-4148-b00a-f016446d3738 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.670815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:38.678247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:38.679130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:38.679973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:38.685025 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 276/539] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:38.686264 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.717562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.718836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.719454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.719954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.721449 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:38.723539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:38.726018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:38.746648 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 264/540] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:38.748717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.796647 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ac4a-dae5-4eeb-877f-a607a440492d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.838819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.839558 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.839841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.840117 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.840868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:38.841171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:38.842620 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a61863-bc95-4c5a-ac63-b4ef585bc7f0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:38.856827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 277/541] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:38.856827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806957b-5295-4dc0-bb87-fea4b65fc761 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.856827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806957b-5295-4dc0-bb87-fea4b65fc761 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.856827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806957b-5295-4dc0-bb87-fea4b65fc761 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.858344 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 278/542] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:38.859812 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806957b-5295-4dc0-bb87-fea4b65fc761 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:38.869960 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb0d7-c6f3-426a-b1a5-a361aceb004d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:38.904527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:38.905697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.906149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.906623 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.914072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:38.916320 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ad93a69c-e2fb-4086-b015-998662503d24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:38.930747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:38.932194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:38.933074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:38.935267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 265/543] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:38.936461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:38.936743 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:38.937017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:38.953193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:38.954406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:38.973053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806957b-5295-4dc0-bb87-fea4b65fc761 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.007276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.008064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.008337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.008604 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.018406 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.019841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.021089 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 266/544] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:39.021931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:39.050126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.051251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.052373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:39.052373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:39.052373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.052373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:39.055736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 279/545] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.056794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.137804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef839-d27f-43dd-884e-3131ad78e078 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.164266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0a4df-00e6-464d-8b6f-df448c5d08ac None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.185217 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.186223 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.186565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.186839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.187671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:39.187981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.189485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.198592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.199390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.199676 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.200066 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.210421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 267/546] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:39.211032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:39.211700 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:39.219728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.220650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 280/547] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.226490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.314216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6944b-8484-4ac6-a1b0-313e3d573065 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.339954 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7635f-c39f-4623-a7eb-029ce08352c5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.346570 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.347229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.347503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.347774 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.348484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:39.348778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.350384 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.362051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 268/548] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:39.362914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.374644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.375433 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.375779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.376055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.387593 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.389048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-65ca85bd-bddc-4e66-a6a2-25cf1f804070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:39.406425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.407481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.408390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:39.408390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:39.408390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.408390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:39.408390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 281/549] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.409124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c298b-f374-4df7-85ce-cb9e84d6255d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.409413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c298b-f374-4df7-85ce-cb9e84d6255d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.409692 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c298b-f374-4df7-85ce-cb9e84d6255d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.411258 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 282/550] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:39.411964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c298b-f374-4df7-85ce-cb9e84d6255d None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.466114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c23c11-1d50-41bf-9fb7-c4918d162187 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.497397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.498058 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.498437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.498715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.499446 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:39.499749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.501146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.511883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 269/551] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:39.512742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.518073 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c298b-f374-4df7-85ce-cb9e84d6255d None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.551928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.552715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.552995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.553268 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.560353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.561791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-6c7034c9-0ded-4db4-a408-b1df4f4b9901 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:39.576560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.577671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:39.578674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 283/552] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.579240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.579381 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.579653 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.595910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:39.597113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:39.616173 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143f850-f41c-488c-b574-2b837bb70cc0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.648034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.648684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.648958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.649228 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.650680 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:39.650910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.652268 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.661305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 284/553] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:39.662154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.667704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 270/554] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:39.668532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.759791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0d489-116e-40a4-bd87-d41f8460a963 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.768819 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ac48-89f2-447d-8eeb-85f97a146319 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.791957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.792764 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.793042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.793316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.801526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.802188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.802496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.802773 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.803463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.803600 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:39.803906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.804938 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.805324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:39.823289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.824466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.827170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:39.827170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:39.827170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:39.827170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:39.827531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 271/555] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:39.827531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.828852 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 285/556] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.829756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.930145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87727e-b358-49c3-8fbf-4c8b25df5890 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.937698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325742c-9150-48bb-9262-17f0ed45b59a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:39.963736 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.964522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.964800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.965068 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.972917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:39.974405 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:39.975370 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:39.976177 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:39.976461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:39.976735 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:39.989054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:39.990749 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:39.991580 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:39.992519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 272/557] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:39.992978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:39.997710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:39.999378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:40.001304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 286/558] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:40.003104 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.111589 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0837-ccc5-4b2d-a9d7-98b3d2fe4ad0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.120363 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa3933-55db-42ae-8113-3f230428ab93 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.147445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.148231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.148508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.148775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.160664 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.162220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.165291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.166039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.166353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.166633 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.167359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:40.167666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.169085 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:40.180331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:40.181618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 273/559] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:40.183626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.184005 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 287/560] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:40.186113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.297288 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af559e1f-2833-455a-8314-99b0d1bbf161 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.318342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e34-3b6e-460d-b99f-59d662546312 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.333997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.334767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.336700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.337904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.340002 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:40.340466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.342506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.358500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 288/561] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:40.359006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.361208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.361967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.362284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.362764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.363409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:40.363719 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.365164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.380569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 274/562] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:40.381442 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.493801 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98a5b-adfa-4d56-82e0-66c68bc177e0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.499096 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9149f-f431-4fcc-b6f6-da30fd961a7b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.535326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.535945 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.536734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.536900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.537037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.537205 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.537355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.537503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.538383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:40.538821 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.541595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.546992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.548478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:40.566742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:40.574245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:40.575507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:40.576101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 289/563] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:40.576188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 275/564] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:40.576266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.576353 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.676989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f60f-7d64-4bdc-af92-c1d6cf12ad52 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.705213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efaf7d-d8f5-48dc-aa95-f2067ec8d2cb None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.716552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.717450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.717724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.717993 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/32e2241ed2ff4f1e935b69e21838908b/roles/9d94173db5164f44859abb0024cb58f6` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.733375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=32e2241ed2ff4f1e935b69e21838908b, role_id=9d94173db5164f44859abb0024cb58f6)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.735026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.756971 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.757772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.758057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.758367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.770842 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.773179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:40.801448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:40.803329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 290/565] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:40.804356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.821832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 276/566] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:40 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/32e2241ed2ff4f1e935b69e21838908b/roles/9d94173db5164f44859abb0024cb58f6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:40.822512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:40.939332 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8d9a4-a690-4402-a906-1562dadd589d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.955168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bec34-82aa-4573-b1cd-59de6288d846 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:40.975639 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.976450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.976732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.977010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.985214 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.986724 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:40.992963 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:40.994556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:40.994844 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:40.995121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:40.995970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:40.996420 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:40.997832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:41.002840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:41.004229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:41.005417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:41.011186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 291/567] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:41.012177 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.022554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 277/568] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:41.022554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.120908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386fa5-34dd-481b-bf24-9df206efa088 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.134434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772c301-8226-47e1-9e74-ff1f8106e2b1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.155767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.156428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.156709 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.156981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.157702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:41.158006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.159406 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.170774 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.171514 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.171873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.176686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.176848 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 292/569] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:41.176944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:41.177046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.177132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.177132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.193596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 278/570] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:41.193596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.305566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821280b-4401-48ff-9d3d-867307ad5954 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.310034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526999ec-65d5-4871-b039-9a73d1431279 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.342703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.343504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.343789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.344063 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.346397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.347235 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.347517 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.347787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.351924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.354027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.359940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.365708 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:41.369325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:41.375573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 279/571] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:41.376485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:41.380595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:41.381485 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:41.382396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:41.382396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:41.382396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:41.382396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:41.386565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 293/572] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:41.387985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.479021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd7304-05f3-4ecd-b10c-6dac600e852b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.485470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846838d0-9c37-446d-b5ca-b0d479cdecfa None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.517742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.518708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.518992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.519267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/530a81ba35704a64a07d373ef18b4ab1/roles/9d94173db5164f44859abb0024cb58f6` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.521854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.522949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.522949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.523141 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.523893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:41.524195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.525837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.534594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=530a81ba35704a64a07d373ef18b4ab1, role_id=9d94173db5164f44859abb0024cb58f6)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.536040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.546550 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 294/573] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:41.547609 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.626258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 280/574] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:41 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/530a81ba35704a64a07d373ef18b4ab1/roles/9d94173db5164f44859abb0024cb58f6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:41.626258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.682095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5636-0e2e-4538-9ec3-97c0f39b6029 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.730821 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.731412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.731696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.731971 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.732780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:41.733372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.734744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.750342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fa5c0-5d6e-4606-8237-39faee0db5ed None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.752810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 295/575] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:41.754635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.789661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.791251 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.791732 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.792221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.803765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.805634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:41.825484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:41.826824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:41.827769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:41.827769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:41.827769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:41.827769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:41.829426 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 281/576] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:41.834037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.864589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d078e1-6ac5-4ee5-95a2-881daba36f52 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.909387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.910281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.910567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.910840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.918636 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.926272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:41.941538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b024c4-76d3-4a4e-9c85-b196de6a2e2f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:41.943261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:41.944426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:41.945304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 296/577] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:41.952391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:41.982305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:41.983552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:41.983977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:41.984400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:41.985243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:41.985685 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:41.987260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.000271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 282/578] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:42.010252 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:42.061036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09c446-693a-428e-8803-ca4b327c6a17 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:42.099376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:42.100045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:42.100327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:42.100611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:42.101403 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:42.101713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:42.104423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.119893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 297/579] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:42.125838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:42.132039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d851-6b44-410b-9927-b0a2e64a6c80 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:42.167963 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:42.168929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:42.169311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:42.169700 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:42.176898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:42.178481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:42.193395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:42.194520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:42.195546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 283/580] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:42.201267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:42.238114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d1ae7-38f3-482b-8363-11a411b9dd22 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:42.273528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:42.275254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:42.275550 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:42.275829 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/c91e736aa84b449bb0657de099a88ef1/roles/9d94173db5164f44859abb0024cb58f6` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:42.291466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=c91e736aa84b449bb0657de099a88ef1, role_id=9d94173db5164f44859abb0024cb58f6)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:42.292971 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5ef38-db0b-4d74-9f84-302983dedd30 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.305360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686495-abed-40b5-9116-13110b21a383 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:42.340053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:42.340714 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:42.342277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:42.342277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:42.342277 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:42.342525 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:42.343807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.361500 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 284/581] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:42.363060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:42.425068 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 298/582] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:42 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/c91e736aa84b449bb0657de099a88ef1/roles/9d94173db5164f44859abb0024cb58f6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:42.471473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da341dfe-7ec3-48eb-82db-a504bcf6365a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:42.509882 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:42.510744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:42.511029 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:42.511301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/defbe1cd07004860a20a4370f03ff612/roles/9d94173db5164f44859abb0024cb58f6` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:42.528745 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=defbe1cd07004860a20a4370f03ff612, role_id=9d94173db5164f44859abb0024cb58f6)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:42.530259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268074c-a95f-472d-8f72-d961257870f3 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:42.609761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 285/583] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:42 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/defbe1cd07004860a20a4370f03ff612/roles/9d94173db5164f44859abb0024cb58f6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:39:43.544313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab3cce-da64-4f69-a902-ee3a4e666f09 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:43.545153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab3cce-da64-4f69-a902-ee3a4e666f09 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:43.545293 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab3cce-da64-4f69-a902-ee3a4e666f09 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:43.548152 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 299/584] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:43.557217 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:43.557954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:43.558224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:43.586297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:43.588326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:43.707144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 286/585] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:43.748407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab3cce-da64-4f69-a902-ee3a4e666f09 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:43.927692 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab3cce-da64-4f69-a902-ee3a4e666f09 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:43.962675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:43.963475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:43.963969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:43.964256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:43.981036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-7303b349-efd3-4300-9546-b965d74da75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:43.989172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:43.990118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:43.990996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:43.995032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 300/586] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:44.000485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.020203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f96-3c5b-4283-a2d8-599c1972abfc None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.020510 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f96-3c5b-4283-a2d8-599c1972abfc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.020761 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f96-3c5b-4283-a2d8-599c1972abfc None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.022395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 301/587] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:44.027815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.028099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.028371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.048718 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:44.049916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:44.121001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbc6ee-eb1f-4dea-9c52-62d433a30b1e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.142329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 302/588] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:44.158171 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.158861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.159138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.159407 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.160144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:44.160446 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.161850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.165979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.177482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 287/589] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:44.183745 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.296909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25802f3-85ba-4621-9752-c900ff7244d4 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.298547 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25fcf-6c4b-42de-8f7a-1cfca51d21a1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.336575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.337916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.338239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.338662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.350933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.352045 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.353222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.353700 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.358101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:44.365967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:44.366952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:44.367790 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:44.373487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 303/590] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:44.374438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.375550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.377424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:44.405330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:44.406290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:44.407192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:44.407192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:44.407192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:44.407192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:44.412577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 288/591] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:44.413717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.510578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b31cc6-0a5b-46c6-8d88-13ca699b92a5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.519790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe010c-f77c-4515-bc28-ae40d31abdaf None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.545179 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.545944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.546333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.546681 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.547531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:44.547960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.549443 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.561408 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.562739 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.563384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 304/592] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:44.563679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.564132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.564537 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.565335 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:44.565962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.567539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.585642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 289/593] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:44.587546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.678948 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37b782-67ab-440f-8a92-b37fcc4ac8ae None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.696044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941eaee-a6a8-4bcd-8e72-5333e51d2701 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.715033 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.715840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.716123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.716400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.727782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.729529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.735283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.736315 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.736821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.737291 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] PATH_INFO: `/v3/users/nova` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.745531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.747381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:44.747581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:44.748448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:44.749331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:44.749331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:44.749331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:44.749331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:44.753778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 305/594] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:44.754733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:44.767246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:44.768238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:44.769193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:44.779186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 290/595] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:44.780380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.864082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8660075-6b5e-4b5d-b513-ae44c711ddbd None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.900102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b458-bd72-4c73-baf9-710374a8431a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:44.901413 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.902091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.902408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.902686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.903459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:44.903768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.905203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.922541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 306/596] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:44.923920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:44.938602 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:44.939617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:44.940082 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:44.940572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:44.942003 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:44.942519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:44.944163 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:44.968334 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 291/597] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:44.969571 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.035875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6509-56ef-4723-b042-6d91a5df00c7 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.072285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.073231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.073341 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ec120-8da5-40a9-a8c7-b6894561b70a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.073521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.073799 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] PATH_INFO: `/v3/users/glance` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.081469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.082957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b3853860-8a27-42e8-aaca-61599f7e4c1e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:45.098774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:45.099770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:45.100746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 307/598] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:45.101489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8274-9a86-467f-bd77-c557c2c8dfa0 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.101489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8274-9a86-467f-bd77-c557c2c8dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.102319 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8274-9a86-467f-bd77-c557c2c8dfa0 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.104272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 308/599] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:45.107839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f8274-9a86-467f-bd77-c557c2c8dfa0 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.120343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.121134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.121516 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.121764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.195684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.198235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.217935 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f8274-9a86-467f-bd77-c557c2c8dfa0 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.251761 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.252427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.252703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.252972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.254054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:45.254391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.255804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4ddc9-026d-44cd-ab63-db1fa9edbe32 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.280290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 309/600] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:45.280290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.280290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.280290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.297250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:45.297640 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 292/601] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:45.298543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.302996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:45.367200 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 310/602] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:45.368125 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.395646 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc075734-20bf-4d4d-ac55-656d26943753 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.429123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.429768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.430052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.430367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.464985 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f3307-c484-4d69-a7e5-2b0e5d0ee163 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.497775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.498644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.499256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.499438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.499724 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.500003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.510927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.512548 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-a28a41d9-033a-4cd2-8f0c-70b2cd487877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:45.530302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:45.531241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:45.532123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:45.532123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:45.532123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:45.532123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:45.532123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 311/603] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:45.532793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045cdc-1e62-4f8c-92aa-33240be19c92 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.533038 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045cdc-1e62-4f8c-92aa-33240be19c92 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.533315 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045cdc-1e62-4f8c-92aa-33240be19c92 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.534594 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 312/604] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:45.535287 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b045cdc-1e62-4f8c-92aa-33240be19c92 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.599737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 293/605] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:45.600595 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.635308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b045cdc-1e62-4f8c-92aa-33240be19c92 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.668808 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.669593 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.669871 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.670143 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.680044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-bf33e044-ea0a-4676-81e3-bce61b69294b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:45.687895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:45.688960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:45.689787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 313/606] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:45.690831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.690831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.690831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.693950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0a78c-ef1e-42d9-ae8b-c7fca5545efb None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.707686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:45.708900 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:45.726571 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.727162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.728098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.728382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.729094 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:45.729394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.730786 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.741823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 294/607] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:45.742694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.774878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 314/608] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:45.775745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.840560 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070c3e-4d4d-4ee6-ab54-df511699ae92 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.873073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.873232 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe738-82e6-4abb-b996-69d883ba17ac None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:45.873864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.874160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.874852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.886272 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.887861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:45.905389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:45.906502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:45.907604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:45.907604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:45.907604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:45.907604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:45.907604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 295/609] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:45.907992 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61486-8122-4815-8f00-446321293d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:45.908084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:45.908155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61486-8122-4815-8f00-446321293d93 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:45.908155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61486-8122-4815-8f00-446321293d93 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:45.908155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61486-8122-4815-8f00-446321293d93 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:45.908738 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61486-8122-4815-8f00-446321293d93 None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:45.909041 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61486-8122-4815-8f00-446321293d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:45.910435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61486-8122-4815-8f00-446321293d93 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:45.919271 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 315/610] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:45.927165 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61486-8122-4815-8f00-446321293d93 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.007960 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed985-360e-44fa-9c9a-754369cc51e1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.014696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61486-8122-4815-8f00-446321293d93 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.040650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.041590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.041737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.042016 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.048605 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.048841 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.049388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.049661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.049932 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.050356 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.060345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:46.071206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.072735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 296/611] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.073822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:46.074535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.075533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 316/612] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.076500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.171189 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61041-b6d9-4cb5-be2e-1e0523e46a40 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.172816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de3a8-ddf5-4201-a697-20922e5dffe8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.204171 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.204834 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.205116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.205392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.206105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.206441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.207910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.208734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.209516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.209845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.210098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.219300 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 297/613] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.220218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.222186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.223951 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:46.242190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.243908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.244849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:46.244849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:46.244849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:46.244849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:46.244849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 317/614] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.245254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.321321 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5977c-b038-443a-95f0-7239b691b04e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.341493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095633-ac86-4ac7-adc6-240a625bd78b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.358730 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.359855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.360370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.360881 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.362415 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.362965 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.364745 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.376818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.377319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 298/615] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.377483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.377767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.378045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.378124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.379080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.379391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.380772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.389862 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 318/616] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.390715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.486329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0694d-4711-4410-abad-75ab9e8cdb4e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.494351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944a8b0-24b6-459c-91f3-53043912d3c6 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.519972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.520802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.521074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.521347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.527151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.527808 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.528090 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.528365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.528456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.529084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.529391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.529838 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.530778 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.542732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 319/617] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.543534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:46.543767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.544599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:46.545490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 299/618] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.546722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.642107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ae87-e8d1-416d-85f6-6312eee23998 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.643238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054588b-f325-44e5-8dc2-a502bb68724e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.674295 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.675114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.675509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.675789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.676552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.677205 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.677492 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.677763 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.678667 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=32e2241ed2ff4f1e935b69e21838908b) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.678981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.680468 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.686340 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 320/619] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/role_assignments?user.id=32e2241ed2ff4f1e935b69e21838908b&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.686481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.687133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.687812 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:46.705654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.706737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.707628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:46.707628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:46.707628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:46.707628 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:46.710569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 300/620] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.712525 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.812817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8070752-72c7-4078-b7d8-01387facda5d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.819656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846b36-f5fa-4c5c-b495-0f2857ff31c0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:46.850423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.851522 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.851947 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.852981 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.855625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:46.856298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:46.856582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:46.856858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:46.857651 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:46.857956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.859456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.862263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:46.863712 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:46.875868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 301/621] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:46.875868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:46.880608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:46.881892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 321/622] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:46.889707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:46.987641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c57141-c2c7-4be4-b925-2a54edbbca04 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.006727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799ebd-9a85-4f88-a05a-739ae8efa42e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.022421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.023199 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.023375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.023652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.025157 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:47.025656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.026908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.039085 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 302/623] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:47.040467 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.048753 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.050020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.050438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.050824 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.052117 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=530a81ba35704a64a07d373ef18b4ab1) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:47.052845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.054979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.063206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 322/624] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:46 2022] GET /identity/v3/role_assignments?user.id=530a81ba35704a64a07d373ef18b4ab1&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:47.064119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.175350 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954474-f6d9-44fe-ab0f-f9159f8c22f7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.190284 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf551d9-e080-4deb-9864-1e9df1aec4d8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.212789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.213672 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.214015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.214399 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.215324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:47.216170 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.217235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.232257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.233364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.233791 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.234238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.241430 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 303/625] 10.222.0.44 () {56 vars in 1139 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:47.242590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.250501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.256308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:47.276480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:47.277618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:47.280528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 323/626] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:47.285691 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.398080 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780db3-f12f-41b8-ab3b-08d39ac08d46 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.426054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433b4aa-3ec0-48d4-b52e-d6711ea38f2f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.443189 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.444454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.444956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.445786 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.473251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.473966 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.474278 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.474552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.475689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:47.475999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.478352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.499909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 324/627] 10.222.0.44 () {56 vars in 1137 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:47.505305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.547367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.549275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.623094 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ad636-f07b-4279-8729-c2745f34cc29 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.663492 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.665129 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.665622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.666123 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.679309 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 304/628] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:39:47.680315 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.742345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.744291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.792922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21707-708d-4cf1-9f74-43b24dfcddcf None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:47.850231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:47.850231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:47.850231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:47.850231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:47.861089 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:47.863800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:47.887321 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 325/629] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:47.888611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:47.910167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:47.912001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:47.914397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:47.914397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:47.914397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:47.914397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:47.914397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 305/630] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:47.922225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.005062 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff638-aab0-42f7-b1c8-d6d86cda2cdc None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.030618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8297-adb1-4472-81d9-c5cd4b604e85 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.041461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.042284 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.042570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.042849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.053552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.054975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.066028 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.066795 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.067073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.067379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.068102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.068403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.069801 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:48.073962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:48.076030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:48.078239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:48.078239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:48.078239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:48.078239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:48.082063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 326/631] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:48.082063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.082313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 306/632] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:48.087882 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.188691 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae218-dfe5-4e9b-8dde-1eb1a0f8a626 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.188904 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31526-7d24-47ad-b86c-adfcfb809c39 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.222723 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.223541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.223755 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.224130 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.224239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.224475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.224647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.224750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.225639 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.225949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.232825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.233196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.234944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.244858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 327/633] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:48.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:48.252037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:48.252929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:48.253635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.254270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 307/634] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:48.259687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.351983 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbd70-8a40-4ae1-9356-81bf97fd409d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.360281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d968f-a46c-4b26-b4b3-cb45ed2d6c5f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.394364 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.395955 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.396333 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.396696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.397129 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.397464 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.397898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.398362 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.400032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.401021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.403138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.406106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.407383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.422027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 308/635] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:48.423067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:48.423930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:48.424803 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 328/636] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:48.426215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.429645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.531578 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ab4e-f90b-45d9-babb-058ee410fd50 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.540478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836bfa8-d623-4ca0-be34-e71f91ac7dba None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.566818 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.567871 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.568359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.568863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.569887 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=defbe1cd07004860a20a4370f03ff612) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.570433 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.572968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.575357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.576027 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.576310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.576587 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.577375 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.577683 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.579156 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bdf98-0a4a-474f-a195-8ad2692d680e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.580951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 309/637] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/role_assignments?user.id=defbe1cd07004860a20a4370f03ff612&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:48.605104 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 329/638] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:48.610666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:48.735590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1378a4-6a58-4b7a-8a60-fadfae8a8862 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:48.781136 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:48.782283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:48.782782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:48.783263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:48.784374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=c91e736aa84b449bb0657de099a88ef1) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:48.784970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:48.787016 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4278-71f4-4d2d-8ad4-8ec46a100826 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:48.795007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 310/639] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:48 2022] GET /identity/v3/role_assignments?user.id=c91e736aa84b449bb0657de099a88ef1&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:49.194225 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b718-1093-477f-807c-95c0b11fe445 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.194719 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b718-1093-477f-807c-95c0b11fe445 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.194719 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b718-1093-477f-807c-95c0b11fe445 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.196998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 330/640] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:49.202827 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.203118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.203397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.221372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:49.222634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:49.296902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 311/641] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:49.323483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1b718-1093-477f-807c-95c0b11fe445 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:49.436503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1b718-1093-477f-807c-95c0b11fe445 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:49.474021 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:49.474908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.475191 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.475473 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.488736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-2a185a95-ab29-47bb-97a2-b59bc96a3799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:49.497357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:49.498489 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:49.499408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 331/642] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:49.507386 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:49.612347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119ad3-2f36-4bc2-898d-dc35a58944a1 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:49.648644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:49.650398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.650869 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.651349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.652301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:49.652802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:49.654381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:49.663711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 312/643] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:49.670431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:49.670830 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235fde-e70e-4239-8457-2080039f8bf9 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.671212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235fde-e70e-4239-8457-2080039f8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.671495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8235fde-e70e-4239-8457-2080039f8bf9 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.674260 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 332/644] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:49.678499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.678788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.679112 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.696167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:49.697478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:49.772320 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 333/645] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:49.792770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16b70-a6ad-4590-9ade-7783e20ce3d6 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:49.796731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:49.835173 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:49.836312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.837314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.838073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.855381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:49.857970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:49.880032 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:49.880966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:49.881864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:49.881864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:49.881864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:49.881864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:49.888778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 313/646] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:49.890399 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:49.918672 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934503-c1fa-4bee-8eac-677d28615fe2 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:49.960697 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:49.963480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:49.963990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:49.964640 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:49.966239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:49.967986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:49.986227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:49.991603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:49.992446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 334/647] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:49.994441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.015695 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae1e2-5a29-43f0-9151-7bb35e08b10f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.054385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.056225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.056721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.057382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.058977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:50.059495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.061923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.082822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 314/648] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:50.083503 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.120243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f0544-4f99-4e41-9ab5-0d7bf7d400b6 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.163809 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.164881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.165426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.165855 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.166767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] RBAC: Adding query filter params (name=image) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:50.167359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.169732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.175810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 335/649] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:50.181355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.213357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c030e-5a45-44bd-af50-1c41d15a9de4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.259213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.260369 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.261313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.261804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.271911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.274673 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.286654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aedba8-52e3-416b-9bf5-d2aef8a8ec0f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:50.295511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:50.296567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:50.297566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:50.301004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 315/650] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:39:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:50.306308 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.334980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.335802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.336219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.337138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.338177 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] RBAC: Adding query filter params (type=image) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:50.338610 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.340144 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.350351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 336/651] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:50.424313 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bd48-6c11-498c-af9b-2fc9e5b52640 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.463164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.464124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.464658 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.465072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.466144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:50.466616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.468211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.488036 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 316/652] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:39:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:50.494229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.611531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4e62-01e2-4438-87e1-e31ee736db74 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.646756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.647412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.647699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.647980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:50.723984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:50.725557 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:50.828589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 337/653] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:39:50.834041 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:50.952604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd894-28a5-4e0e-a14f-80123623a021 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:50.988727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:50.989912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:50.990482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:50.990955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.002464 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.004491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-46016fa9-16fa-47d8-89de-a4f6c5fc8f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:51.023784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:51.025359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:51.026314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:51.026314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:51.026314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:51.026314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:51.028663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 317/654] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:51.035297 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.103055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a603c-e819-4bf0-931d-a4686dd6a134 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.103258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a603c-e819-4bf0-931d-a4686dd6a134 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.103781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a603c-e819-4bf0-931d-a4686dd6a134 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.105430 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 318/655] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:51.112941 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.113370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.113760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.137108 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:51.138699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:51.149869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014138-e915-424c-aac4-9513506c7e79 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.186496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.187415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.187846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.188303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.189172 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:51.189624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.191188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.205686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 338/656] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:51.211246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.234365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 319/657] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:51.251653 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.364229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683e8a-9597-4bdf-bd44-d1efa858376c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.399790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.400647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.400923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.401197 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] PATH_INFO: `/v3/services/network` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.401840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.403235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ec07c8e3-426c-4cf7-b6f5-9ef81d2816bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:51.416955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:51.418365 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:51.419400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:51.426221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 320/658] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:51.426221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2509d3-5494-4d5f-a889-a0cf91444c7f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.426221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2509d3-5494-4d5f-a889-a0cf91444c7f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.426221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2509d3-5494-4d5f-a889-a0cf91444c7f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.426221 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 321/659] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:51.427492 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2509d3-5494-4d5f-a889-a0cf91444c7f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.448321 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f1e85-2884-4bc1-b171-dd9169b8ab63 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.483062 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.483851 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.484128 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.484389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.491949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.493415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-088f685c-b7e7-4e1f-98f9-595f0a3b0b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:51.507342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:51.508270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:51.510529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 339/660] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:51.511023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.511023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.511314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.528858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:51.530060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:51.543230 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2509d3-5494-4d5f-a889-a0cf91444c7f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.579625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.580685 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.581207 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.581667 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.582585 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] RBAC: Adding query filter params (name=network) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:51.583073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.584635 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.590351 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 322/661] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:51.591477 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.604912 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 340/662] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:51.605957 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.714278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026947e-3a64-4743-8bc4-5d8cdb1c7e4f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.718094 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a7839-201c-4948-bc7c-f2a0aa21267e None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.748046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.748709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.748996 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.749275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.750055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:51.750428 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.751830 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.751934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.752512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.752794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.753069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.754071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] RBAC: Adding query filter params (type=network) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:51.754409 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.755758 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.770567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 341/663] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:51.770567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.776298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 323/664] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:51.782125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.876067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0506-4172-4e8b-884a-504244c30750 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.905087 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790157f-0f9b-47cb-bd49-9eeca6b6df61 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:51.915438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.916566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.916879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.917155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.917816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.919268 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:51.933392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:51.934455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:51.935299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 342/665] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:51.941337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:51.949724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:51.960943 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:51.961368 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:51.961651 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:51.962670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=32e2241ed2ff4f1e935b69e21838908b) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:51.962993 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:51.964557 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:51.980125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 324/666] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/role_assignments?user.id=32e2241ed2ff4f1e935b69e21838908b&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=5067df1fd41e4852bda05f53294ab802 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:52.069944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d665a1-ac86-4211-af5c-f80b873392c1 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:52.111808 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:52.112641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:52.113030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:52.113407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:52.114259 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:52.114692 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:52.116345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399954e-f8f5-4381-bd8b-7513650bc76b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:52.126188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 343/667] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:39:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:52.128817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:52.240806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99fecf-8937-4fc4-afda-46793c3e694e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:52.275933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:52.276762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:52.277149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:52.277553 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:52.278402 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:52.278810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:52.280293 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1b76-613f-46bf-a17d-7a1bdc611632 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:52.290276 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 325/668] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:39:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:52.765924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ab5-7a86-4c60-9a6b-da937e2b98cc None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:52.766507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ab5-7a86-4c60-9a6b-da937e2b98cc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:52.766507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2891ab5-7a86-4c60-9a6b-da937e2b98cc None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:52.768255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 344/669] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:52.774913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08034-afd3-4b40-a224-41679486fa01 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:52.775193 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08034-afd3-4b40-a224-41679486fa01 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:52.775473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08034-afd3-4b40-a224-41679486fa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:52.794420 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d0f08034-afd3-4b40-a224-41679486fa01 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:52.796018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d0f08034-afd3-4b40-a224-41679486fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:52.867617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 326/670] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:52.897320 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2891ab5-7a86-4c60-9a6b-da937e2b98cc None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:53.001437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2891ab5-7a86-4c60-9a6b-da937e2b98cc None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:53.040397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:53.041100 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:53.041380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:53.041652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:53.042469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:53.043870 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e20e23-fa52-4a7f-a8de-83ced3d26efb None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:53.169762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 345/671] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:39:52 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:54.238878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efd89-9a98-4a5e-8ce6-eae708e0c64e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.239490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efd89-9a98-4a5e-8ce6-eae708e0c64e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.239490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7efd89-9a98-4a5e-8ce6-eae708e0c64e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.241144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 327/672] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:54.247360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e9cb-55e1-412b-9daa-ed8cbfcf4e2f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.248037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e9cb-55e1-412b-9daa-ed8cbfcf4e2f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.248037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e9cb-55e1-412b-9daa-ed8cbfcf4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.265965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-0671e9cb-55e1-412b-9daa-ed8cbfcf4e2f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:54.267213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-0671e9cb-55e1-412b-9daa-ed8cbfcf4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:54.348998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 346/673] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:54 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:54.373432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7efd89-9a98-4a5e-8ce6-eae708e0c64e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:54.435503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2efe0-6dbd-4fc7-9871-344aac0f5fe2 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.435999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2efe0-6dbd-4fc7-9871-344aac0f5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.436486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2efe0-6dbd-4fc7-9871-344aac0f5fe2 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.438040 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 347/674] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:54.445153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.446328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.446843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.465999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:54.467615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:54.498759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7efd89-9a98-4a5e-8ce6-eae708e0c64e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:54.535494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:54.536156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.536438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.536717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.537460 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:54.538918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cde70-6293-4917-b9b3-0ebbc0a8440e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:54.546432 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 348/675] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:54 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:39:54.570737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:54.639745 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 328/676] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:39:54 2022] POST /identity/v3/services => generated 240 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:39:54.685960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907a5a-b5d2-494a-87d6-5c3d75357df7 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:54.750540 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:54.751327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.751612 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.751893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.760328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a31a-0720-4e57-bfd5-8dd8c588a61c None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.760954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a31a-0720-4e57-bfd5-8dd8c588a61c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.761461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a31a-0720-4e57-bfd5-8dd8c588a61c None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.763548 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 329/677] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:54.764924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:54.770255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.770255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.770255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:54.773196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:54.774881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:54.776048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 349/678] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:54.781013 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:54.797381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:54.799044 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:54.885767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 330/679] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:54 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:39:54.910727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:54.929358 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da72e49-e96a-415f-81fc-e5a0bf12f5af None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:54.964818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:54.966036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:54.966669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:54.967160 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:54.968124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:54.968666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:54.970289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:54.980153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 350/680] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:54.986008 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.027853 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3556-833a-4dc8-8710-28828f06e3fc None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.064456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.075679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.075679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.075679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.075679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.075679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.122408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0f6a-0799-4322-9a85-ae10c496e149 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.161544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.162363 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.162678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.162924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.174221 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.175683 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:55.194606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:55.198907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:55.200109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:55.200109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:55.200109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:55.200109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:55.200109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 351/681] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:55.202630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.242373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 331/682] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:39:54 2022] POST /identity/v3/services => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:39:55.324906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5bad-3b68-4c51-82f3-02fedc53a927 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.371535 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.372615 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.373136 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.373629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.374616 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:55.375147 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.376770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.391996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 352/683] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:55.400126 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.516511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f053-2878-45ac-9959-1d7811274d39 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.552861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.553752 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.554019 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.554321 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.562940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.564419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-0316058e-4d46-442e-86c9-58821679a87e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:39:55.579421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:55.580432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:55.582035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 332/684] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:55.588032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.634676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9289-9427-4601-aaaf-b19d98c2176f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.635019 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9289-9427-4601-aaaf-b19d98c2176f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.635289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9289-9427-4601-aaaf-b19d98c2176f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.636921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 333/685] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:55.642234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.642535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.642809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.660176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:55.661374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:55.703945 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9fbd-fc61-4413-ab50-c29da5fc2bfb None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.741502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 334/686] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:39:55.747618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.748299 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.748581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.748858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.749696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:55.750001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.751470 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.762724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.775384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 353/687] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:55.781607 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.896378 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4feb84-147e-400c-93f0-8152bcbfe11f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.916439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5db0c-88f0-4eda-85fd-46ca7d9dcd21 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:55.935507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.936409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.936736 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.937083 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.937809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.939319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:55.951985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:55.953064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:55.953905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 335/688] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:55.958304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:55.959196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:55.959572 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:55.960030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:55.960490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:55.972433 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:55.974167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:39:55.993042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:55.994229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:55.995209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:39:55.995209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:39:55.995209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:39:55.995209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:56.001779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 354/689] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:56.002987 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.084179 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa4d7a-f382-49fc-94e7-abe5c674d5f1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.113446 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df836c6-415c-4e48-95be-c1a91620ff7b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.122375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.122980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.123264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.123544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.124256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] RBAC: Adding query filter params (name=image) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:56.124940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.126721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.133928 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 336/690] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:56.143396 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.152590 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.153492 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.154517 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.154949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.155850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:56.156641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.158817 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.174746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 355/691] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:56.180795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.267048 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4960f3-5455-4565-bd84-c47a908c3fb5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.286160 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0316e62-c3fc-4c60-b276-beafcc6b1e1e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.302232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.302791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.303072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.303343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.304034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] RBAC: Adding query filter params (type=image) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:56.304336 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.306508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.316065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 337/692] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:56.317148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.325599 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.326962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.327393 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.327831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.335040 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.336844 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:39:56.350902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:56.352173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:39:56.353219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:56.355346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 356/693] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:56.364086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.422572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a570-7767-45c7-9c5d-a23ea345d56b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.460830 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.464063 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.465453 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.466594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.468394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] RBAC: Adding query filter params (interface=public, service_id=fe38754a56c94673859f0989a460da36, region_id=RegionOne) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:56.469213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.472215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.482459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 338/694] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/endpoints?service_id=fe38754a56c94673859f0989a460da36&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:56.489255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.495155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8f8b3-c46e-428b-a6b5-568f7cb622cc None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.532930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.533596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.533872 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.534134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.535567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:56.535567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.536654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.555459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 357/695] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:56.556304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:56.609418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d76974-596e-4cca-9beb-80ab04cbf70f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.650993 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.651968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.652394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.652812 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.653635 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.655197 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8a30d-fcb5-43c4-a46a-5857b08f150f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.661535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 339/696] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:39:56 2022] GET /identity/v3/services => generated 1002 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:39:56.678914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a025f1-c80b-48e0-876e-cc2e3259f4a9 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:56.719031 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:56.719921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:56.720196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:56.720468 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/32e2241ed2ff4f1e935b69e21838908b/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:56.722608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=32e2241ed2ff4f1e935b69e21838908b, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:56.724079 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1596f-5262-448a-9cea-44955f08630c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:56.815795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 358/697] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:39:56 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/32e2241ed2ff4f1e935b69e21838908b/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:39:57.191604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83205-91fb-4c92-8a20-aec201bf3725 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.191970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83205-91fb-4c92-8a20-aec201bf3725 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.192160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83205-91fb-4c92-8a20-aec201bf3725 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.195337 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 340/698] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:57.202188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.202515 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.202779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.222637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:57.223979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:57.300794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 359/699] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:39:57.326666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83205-91fb-4c92-8a20-aec201bf3725 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:57.447650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83205-91fb-4c92-8a20-aec201bf3725 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:57.487657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:57.489925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.489925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.489925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] PATH_INFO: `/v3/services/network` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.489925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:57.491284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:57.504842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:57.505913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:57.506794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 341/700] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:39:57 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:39:57.515885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:57.626941 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ec034-9aa0-4ab6-8cec-b8fcfd9e9b20 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:57.662431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:57.663160 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.663448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.663736 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.664984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] RBAC: Adding query filter params (name=network) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:57.665322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:57.666727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c293ff3-72ea-4bf3-b8cd-1bae5c622cd0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:57.672085 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 360/701] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:39:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:57.677778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:57.759245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef0bc-a9d3-42cd-8a59-c1a7e23c6e95 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.759245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef0bc-a9d3-42cd-8a59-c1a7e23c6e95 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.759641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef0bc-a9d3-42cd-8a59-c1a7e23c6e95 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.761275 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 361/702] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:57.769553 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.769990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.770707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.790581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d48b5-73bf-40fa-9429-2a87cb727cd1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:57.794632 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:57.795959 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:57.833750 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:57.834513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:57.840113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:57.840113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:57.840113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] RBAC: Adding query filter params (type=network) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:57.840113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:57.840113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:57.846223 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 342/703] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:39:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:57.853314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:57.898346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 362/704] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:39:57.933280 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:57.986267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac17d2-a224-42af-807a-3f262b15fe10 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.036851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.038254 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.038711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.039429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.041500 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] RBAC: Adding query filter params (interface=public, service_id=e7b24c2ec9604c8cb36790711f510ed1, region_id=RegionOne) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:58.041997 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.044293 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.045380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd97b6-e626-4265-afdb-6220f10d7ff9 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.056679 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 343/705] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:39:57 2022] GET /identity/v3/endpoints?service_id=e7b24c2ec9604c8cb36790711f510ed1&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:58.057348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:58.096431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.098928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.099533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.100028 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.101076 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.103370 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:58.121037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:58.122098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:39:58.123011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:58.123815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 363/706] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 12 16:39:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:58.130948 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:58.181980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e4da-0b60-40ca-9c8c-1c2661d7179e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.220379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.221498 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.221991 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.222559 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.223497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.225302 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.238550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 344/707] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:39:58 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:39:58.245529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3c1a0-87aa-4052-a93a-6f62593dae99 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.287721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.288320 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.288605 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.288886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.289739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:58.290306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.291705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.297704 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 364/708] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:39:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:58.303466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:58.429576 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636718a-eeca-44c3-a1d1-d8589092101b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.472434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.473113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.473393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.473669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.474417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:58.474723 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.476111 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.483417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 345/709] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:39:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:58.489801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:58.627532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c80c5-cc44-43eb-a582-d626b8c678ac None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.683251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.684329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.684869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.685348 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.686392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] RBAC: Adding query filter params (interface=public, service_id=476f525d21584767a9071353d375bfdd, region_id=RegionOne) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:58.686923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.688534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a897c-0b9d-40f8-9866-e5e13fad1af3 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.698308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 365/710] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:39:58 2022] GET /identity/v3/endpoints?service_id=476f525d21584767a9071353d375bfdd&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:39:58.703632 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:58.848211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae586f06-7e77-48cf-ab9d-fe825d939a5e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:58.906290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:58.907090 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:58.907625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:58.908037 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:58.909082 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:58.911203 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4325c7-0e52-4bc9-8ba9-c87549860706 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:58.919762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 346/711] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:39:58 2022] GET /identity/v3/services => generated 1002 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:39:59.212367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b1e1-4ac3-4645-818f-d5fee7817e18 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.212367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b1e1-4ac3-4645-818f-d5fee7817e18 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.212367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578b1e1-4ac3-4645-818f-d5fee7817e18 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.212367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 366/712] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:39:59.212942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815740-2664-4130-aa77-15cd9169989b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.212942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815740-2664-4130-aa77-15cd9169989b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.212942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815740-2664-4130-aa77-15cd9169989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.231092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-50815740-2664-4130-aa77-15cd9169989b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:59.232675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-50815740-2664-4130-aa77-15cd9169989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:59.323250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ae77-7d47-4019-868e-637ba171730d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.323628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ae77-7d47-4019-868e-637ba171730d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.323882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ae77-7d47-4019-868e-637ba171730d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.325560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 367/713] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:39:59.331150 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.335311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.335431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 347/714] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:39:59.335522 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.350045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:39:59.351308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:39:59.363254 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815740-2664-4130-aa77-15cd9169989b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.453868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 368/715] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:39:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:39:59.479490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.497654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815740-2664-4130-aa77-15cd9169989b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:59.548911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:59.551781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.552576 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.553676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] PATH_INFO: `/v3/services/image` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.555766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:59.561371 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:59.586181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:59.591244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:39:59.593220 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:39:59.605158 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 348/716] 10.222.0.44 () {56 vars in 1105 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/services/image => generated 86 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:59.608133 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.616245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471bd29-d6e0-4da1-8458-5f96d58ac654 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:59.654943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:59.655587 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.655587 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.655955 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.667754 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:39:59.675693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:39:59.676711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:39:59.677854 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 369/717] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:39:59.683541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.753311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb2eea-5467-41c4-9a6c-8811477f4841 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:59.791422 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:59.792463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.792977 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.793479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.794448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] RBAC: Adding query filter params (name=image) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:59.794969 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:59.796671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:59.807110 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 349/718] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:59.808686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.829024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39362ef-41a9-43e7-b9e6-61754ee8834b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:59.865316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:59.865996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.866312 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.866595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.870747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:59.870747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:59.870747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:59.879649 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 370/719] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:39:59.889263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:39:59.944829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdfdb1-9f0c-4bac-b1dd-fd7e9f1ba74d None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:39:59.982448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:39:59.983741 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:39:59.984420 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:39:59.985065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:39:59.986418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] RBAC: Adding query filter params (type=image) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:39:59.986877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:39:59.988475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:39:59.999332 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 350/720] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:00.001028 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05d2f-6d87-4fd1-8eed-76eed2282499 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.001621 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:00.036289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.037159 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.037542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.037929 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.049834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.051493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:40:00.069291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:00.070501 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:00.071634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:40:00.071634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:40:00.071634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:00.071634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:00.078372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 371/721] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:00.081532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:00.114249 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8d129-9e44-4d64-ab0d-f22b9f067a23 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.151282 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.152276 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.152803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.153262 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.154219 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.155867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.188600 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d097-4cfa-45d1-bd46-49f030ee1e49 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.230534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.231408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.231858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.232280 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.233186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:00.233622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.235494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.257006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 372/722] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:00.259840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:00.294487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 351/723] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:39:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:40:00.388691 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9265d8-fa8b-4701-b9f3-6d013fb17599 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.437083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.438326 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.438847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.439352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.449541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.451505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:40:00.468894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:00.469921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:40:00.470890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:00.473693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 373/724] 10.222.0.44 () {56 vars in 1093 bytes} [Thu May 12 16:40:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:40:00.481258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:00.602474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b06b-ea2b-49a1-ba8d-1de9d47ff197 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.642071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.642804 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.643091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.643372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.644240 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:00.644554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.646084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08416-3da9-4b96-ae1a-9f8d99ac82be None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.675189 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 352/725] 10.222.0.44 () {56 vars in 1133 bytes} [Thu May 12 16:40:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:00.680887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:00.798345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2f3c-7806-49cb-87e7-a2e32b1fa237 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:00.841334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:00.842721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.843403 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.844142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.850872 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840303-05a9-483e-b045-a3965a381f0d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.851198 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840303-05a9-483e-b045-a3965a381f0d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.851436 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840303-05a9-483e-b045-a3965a381f0d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.853209 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 353/726] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:00.858781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:00.859069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:00.859351 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:00.889432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:00.891028 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:00.936920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:00.938509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:00.970761 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 354/727] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:00 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:40:00.995001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.057914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 374/728] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:40:00 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:40:01.058914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.121065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e76b75-c3fe-4571-a784-bc55fb4dc4d4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.166982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.168279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.168697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.168974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] PATH_INFO: `/v3/services/network` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.169629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.171655 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:01.188009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:01.189067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:40:01.189926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:01.190724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 355/729] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:00 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:40:01.192160 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4e3b-8c54-4089-ac12-9fc55e0a7fa8 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.197457 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.236595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.237652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.237988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.238301 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.250799 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.253157 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:40:01.273892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:01.275569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:01.276452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:40:01.276452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:40:01.276452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:01.276452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:01.280184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 375/730] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:01.281138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.333667 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa17a-3916-44b5-bd03-2943abe08a7e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.381042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.382756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.383251 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.383925 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.384924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] RBAC: Adding query filter params (name=network) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:01.385423 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.387850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.394243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 356/731] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:01.399671 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.415955 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f7a3-93f4-404c-a28a-bf588ebe196c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.464549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.465646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.466248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.467310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.468625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:01.469204 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.471692 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.494496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 376/732] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:01.495956 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.521573 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfb2c-9e6f-4902-b09f-40894ae0d510 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.558861 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.559526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.559808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.560078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.560766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] RBAC: Adding query filter params (type=network) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:01.561123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.562534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50267d-d9f4-411b-8a9b-2628cfe0ef95 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.574517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 357/733] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:01.574517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75001-7ec8-46a4-bd3f-9a7fa81633c4 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.574517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75001-7ec8-46a4-bd3f-9a7fa81633c4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.574517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75001-7ec8-46a4-bd3f-9a7fa81633c4 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.574517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 358/734] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:01.575306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a75001-7ec8-46a4-bd3f-9a7fa81633c4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.614622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734ac59-5d48-46fb-a1c2-cad07466a52c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.648227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.649479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.649769 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.650048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.657081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.658571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-13820d09-2639-4bc4-a065-808a9537f3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:40:01.673484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:01.674474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:01.675366 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 377/735] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:01.676194 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.676194 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.676484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.697894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:01.699155 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:01.700764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a75001-7ec8-46a4-bd3f-9a7fa81633c4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.736670 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.737325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.737607 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.737885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.738661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.740040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.793262 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 378/736] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:01 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:01.794322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.842717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 359/737] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:40:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:40:01.843727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:01.914285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f35081-c80e-4455-9b70-d562f3a881a3 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:01.961969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:01.963694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:01.963980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:01.964257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:01.965069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:01.965383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:01.967186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:01.991618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 379/738] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:01.994010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:02.138486 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3ace-dfb1-4cd3-97e8-c793e2fd4809 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:02.194483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf1bf7-ac6a-4784-aa35-fffba94291c0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:02.200491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:02.201699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:02.202270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:02.203194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:02.204467 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:02.207519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:02.224980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:02.226806 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:02.228558 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 360/739] 10.222.0.44 () {56 vars in 1129 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:02.232381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:02.247551 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:02.248226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:02.248512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:02.249222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:02.250475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=32e2241ed2ff4f1e935b69e21838908b) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:02.250811 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:02.252606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:02.262956 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 380/740] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:40:01 2022] GET /identity/v3/role_assignments?user.id=32e2241ed2ff4f1e935b69e21838908b&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=5067df1fd41e4852bda05f53294ab802 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:02.400160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00054323-bc43-4041-9e65-f7dc496ba96b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:02.440549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:02.441225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:02.441509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:02.441781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:02.442538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:02.442840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:02.444245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:02.451066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 361/741] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:40:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:02.456533 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:02.604645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163456-00b5-48f7-b69c-27e3b311b725 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:02.643429 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:02.644479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:02.644986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:02.645461 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:02.646416 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:02.646936 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:02.648514 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553c891-4a67-4449-85b7-a19b261f740f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:02.655832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 381/742] 10.222.0.44 () {56 vars in 1124 bytes} [Thu May 12 16:40:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:02.664848 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:02.830626 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2807e5-f05e-4f34-959d-d3a812463bf6 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:02.884169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:02.884169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:02.884438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:02.884637 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:02.885412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:02.887744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18cc32-438b-4f81-a062-15365a64cb76 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:02.994226 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 362/743] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:40:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:03.003056 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81f84-a05f-49c9-96ac-51fe8b3b9c8b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:03.003991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81f84-a05f-49c9-96ac-51fe8b3b9c8b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:03.004360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81f84-a05f-49c9-96ac-51fe8b3b9c8b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:03.006885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 382/744] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:03.014702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:03.015183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:03.015654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:03.173215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:03.174484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:03.251554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 363/745] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:03 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:03.276372 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81f84-a05f-49c9-96ac-51fe8b3b9c8b None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:03.396718 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81f84-a05f-49c9-96ac-51fe8b3b9c8b None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:03.435450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:03.436442 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:03.436964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:03.437442 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:03.531410 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:03.533379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:03.644574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 383/746] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:40:03 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:40:03.650963 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:03.762807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a4db-32c5-4ea0-9ba2-09533b538d2a None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:03.800015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:03.800822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:03.801096 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:03.801367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:03.813604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:03.815352 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-73759cb9-cb51-4aa7-8ccb-657641a59288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:40:03.836329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:03.840556 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:03.841981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:40:03.841981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:40:03.841981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:40:03.841981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:03.841981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 364/747] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:03.843718 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:04.007157 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c786f-c2bb-4186-9944-03ee2517379a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:04.069254 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:04.070020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:04.070492 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:04.070918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:04.071816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:04.072266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:04.073797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d07c2-8b49-400c-95ca-5dceb73521fe None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:04.086809 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 384/748] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:04.761836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41500afe-dc20-4f5d-aa30-d6065471b59f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:04.762120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41500afe-dc20-4f5d-aa30-d6065471b59f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:04.762425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41500afe-dc20-4f5d-aa30-d6065471b59f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:04.763787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 365/749] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:04.769635 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:04.769922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:04.770221 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:04.788175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:04.790016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:04.861248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 385/750] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:04 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:40:04.885915 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41500afe-dc20-4f5d-aa30-d6065471b59f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:04.989936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41500afe-dc20-4f5d-aa30-d6065471b59f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:05.025110 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:05.025840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.026122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.026428 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.027078 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:05.028471 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:05.045007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:05.047148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:05.048740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 366/751] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 12 16:40:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:05.052865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:05.156333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65ded4-6f48-4ea8-97b6-6450c74d7d94 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:05.190255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:05.190918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.191201 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.191478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.192185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:05.192493 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:05.193863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add43b1-5823-44a8-88b7-2edcfa6e38af None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:05.199128 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 386/752] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:05.205092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:05.324661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f26395-cefb-401a-9284-eb56d751ec51 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:05.359978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:05.360760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.361122 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.361478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.362325 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:05.362727 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:05.364285 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0640b4-4a84-4cd2-b534-446e9902484b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:05.370264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 367/753] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:05.446627 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b60c-ef0f-40de-b89c-3632f871e5f1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.447051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b60c-ef0f-40de-b89c-3632f871e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.447451 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b60c-ef0f-40de-b89c-3632f871e5f1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.449382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 387/754] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:05.457096 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.457387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.457665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.479201 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:05.480601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:05.561989 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 368/755] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:05 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:05.585298 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0b60c-ef0f-40de-b89c-3632f871e5f1 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:05.705426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0b60c-ef0f-40de-b89c-3632f871e5f1 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:05.740421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:05.741225 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.741508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.743658 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.743658 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:05.743974 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:05.756529 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:05.757752 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:05.760053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 388/756] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:05.764551 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:05.867405 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c89c7-abd3-442b-800d-30928d0af6c7 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:05.906686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:05.907502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:05.907683 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:05.907879 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:05.908598 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:05.909271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:05.910312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278247-8b00-4f80-b540-bc26ea0c8441 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:05.915343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 369/757] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:05.921543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:06.033868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764f17d-3bba-4000-bd72-acc3578d6890 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:06.068859 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:06.069537 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:06.069782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:06.070052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:06.071536 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:06.071846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:06.073240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc536b-1304-4d10-ba85-0721cedb617e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:06.078395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 389/758] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:08.506631 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd53a8-2aad-4c4c-a565-3179c6963490 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:08.507331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd53a8-2aad-4c4c-a565-3179c6963490 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:08.507331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd53a8-2aad-4c4c-a565-3179c6963490 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:08.509393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 370/759] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:08.515845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c6d9-9cbb-46d7-a368-5dd194bbd036 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:08.516309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c6d9-9cbb-46d7-a368-5dd194bbd036 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:08.516563 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c6d9-9cbb-46d7-a368-5dd194bbd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:08.537614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-25d2c6d9-9cbb-46d7-a368-5dd194bbd036 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:08.538837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-25d2c6d9-9cbb-46d7-a368-5dd194bbd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:08.608923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 390/760] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:08 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:08.642652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd53a8-2aad-4c4c-a565-3179c6963490 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:08.743483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd53a8-2aad-4c4c-a565-3179c6963490 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:08.781482 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:08.782275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:08.782561 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:08.782837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:08.783567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:08.784943 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a002dd-15c0-4a44-996f-d270812527e7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:08.894001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 371/761] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:40:08 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:09.244757 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394477b3-c55b-429f-84d5-a0ba955c79cc None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:09.245121 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394477b3-c55b-429f-84d5-a0ba955c79cc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:09.245399 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394477b3-c55b-429f-84d5-a0ba955c79cc None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:09.246818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 391/762] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:09.252301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f06ad-c008-4891-84f5-066fbf63b509 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:09.252587 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f06ad-c008-4891-84f5-066fbf63b509 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:09.252857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f06ad-c008-4891-84f5-066fbf63b509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:09.271523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-f53f06ad-c008-4891-84f5-066fbf63b509 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:09.272712 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-f53f06ad-c008-4891-84f5-066fbf63b509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:09.347585 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 372/763] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:09 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:09.372549 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394477b3-c55b-429f-84d5-a0ba955c79cc None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:09.476191 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394477b3-c55b-429f-84d5-a0ba955c79cc None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:09.511570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:09.512148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:09.512425 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:09.512695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:09.513415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:09.514841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeeb0a-fe8b-4794-80fe-5f98904dfb89 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:09.669181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 392/764] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:40:09 2022] POST /identity/v3/services => generated 251 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:11.274687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfba8e-7748-4b11-a59b-d32d8f790f2e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:11.275198 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfba8e-7748-4b11-a59b-d32d8f790f2e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:11.275198 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfba8e-7748-4b11-a59b-d32d8f790f2e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:11.276479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 373/765] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:11.281857 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:11.282291 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:11.282553 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:11.299751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:11.300924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:11.369989 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 393/766] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:11.394415 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfba8e-7748-4b11-a59b-d32d8f790f2e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:11.489649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfba8e-7748-4b11-a59b-d32d8f790f2e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:11.523057 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:11.523922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:11.524205 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:11.524480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:11.525175 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:11.526527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:11.538519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:11.539543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:11.540725 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 374/767] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 12 16:40:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:11.546375 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:11.644575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3365c-94a5-44c1-b097-652b21a9e41e None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:11.678894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:11.679610 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:11.680439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:11.680713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:11.681424 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:11.681729 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:11.683143 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:11.688345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 394/768] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:11.694124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:11.808411 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd1f4-e317-4848-ba17-267521210bba None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:11.844559 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:11.845226 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:11.845504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:11.845773 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:11.846517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:11.846823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:11.848224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:11.853388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 375/769] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:11.859360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:11.968541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a15d82-44f7-48f2-8124-f70d7070e92b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.007433 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.008644 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.009154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.009659 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.011233 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] RBAC: Adding query filter params (interface=public, service_id=4be976ffcd724a15a38e9883c795a017, region_id=RegionOne) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:12.011581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.015518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4001b-a2b8-4439-a6da-c9b5437ec523 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.021246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 395/770] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:40:11 2022] GET /identity/v3/endpoints?service_id=4be976ffcd724a15a38e9883c795a017&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:12.027530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:12.087943 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b3a18-3d94-4b4f-a0ed-f641a070d9c1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.088170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b3a18-3d94-4b4f-a0ed-f641a070d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.088420 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b3a18-3d94-4b4f-a0ed-f641a070d9c1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.089777 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 396/771] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:12.095026 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.095307 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.095582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.122849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:12.124333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:12.135780 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982b95a-3a5a-4a31-a1eb-ceff7906be42 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.175264 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.176337 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.176807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.177269 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.178493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.180417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.186487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 376/772] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/services => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:40:12.192831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 397/773] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:40:12.218066 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:12.334339 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8f852-1f01-47b4-a171-d27cf3e07389 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.379052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.379859 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.380138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.380412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.381070 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.382496 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:12.395488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:12.396775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:12.397660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:12.399060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 377/774] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:12.403455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:12.512236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d83469-239c-4dc7-9378-42a32cd9a7de None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.549423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.550180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.550505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.550792 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.551521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:12.551834 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.553211 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.558800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 398/775] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:12.564563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:12.675466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d9cc1-8334-4375-a4c9-8c2c84c445ff None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.721382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.722053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.723432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.723432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.723432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:12.723742 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.725020 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.736540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 378/776] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:12.737583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:12.851219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3576-3eb3-4272-8390-8175a0d65308 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:12.892727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:12.893384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:12.893668 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:12.893947 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:12.894786 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] RBAC: Adding query filter params (interface=public, service_id=576c8011a50a41c2a179157c9a6685d7, region_id=RegionOne) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:12.895101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:12.896463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d03df0-48f4-4ff9-9bfb-491dcf7557cd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:12.901937 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 399/777] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/endpoints?service_id=576c8011a50a41c2a179157c9a6685d7&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:12.907550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:13.017762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f1417-5d80-4ccd-b840-768a27ce3f22 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:13.058523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:13.059200 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:13.059488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:13.059852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:13.060539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:13.061920 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc7d1-2950-47a1-ad9d-d6e5c1a2ad29 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:13.068120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 379/778] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:40:12 2022] GET /identity/v3/services => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:40:14.512450 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e530-09d1-487f-bfe7-7c84bdb8518f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:14.513065 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e530-09d1-487f-bfe7-7c84bdb8518f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:14.513065 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e530-09d1-487f-bfe7-7c84bdb8518f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:14.514399 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 400/779] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:14.519797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:14.520257 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:14.520346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:14.536837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:14.538014 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:14.605165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 380/780] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:14.630068 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e530-09d1-487f-bfe7-7c84bdb8518f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:14.735339 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e530-09d1-487f-bfe7-7c84bdb8518f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:14.773968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:14.775398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:14.775677 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:14.775949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:14.776603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:14.777995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:14.791222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:14.792374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:14.793246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 401/781] 10.222.0.44 () {56 vars in 1132 bytes} [Thu May 12 16:40:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:14.798554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:14.911284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d51f3-a389-482e-9491-d2847ef3742e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:14.944184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:14.944847 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:14.945791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:14.946090 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:14.946815 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:14.947117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:14.948509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:14.953746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 381/782] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:14.959544 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:15.067995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513e23-e66b-4da2-a91e-7315ce6a2bae None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:15.101329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:15.103138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.103417 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.103684 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.104388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:15.104687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:15.106054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d8d21-fca5-47ac-bcea-b8f9f8af3c5b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:15.111349 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 402/783] 10.222.0.44 () {56 vars in 1126 bytes} [Thu May 12 16:40:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:15.116956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:15.220592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99deef-c673-4e9c-87bb-88d7626f000f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:15.258966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:15.259618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.259896 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.260169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.260902 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:15.262298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d5f12-73b2-41c5-9a92-91c541d694cf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:15.345649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 382/784] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:40:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:15.416439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e86c-59ce-475f-9735-64f2b2a86846 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.416707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e86c-59ce-475f-9735-64f2b2a86846 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.416996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626e86c-59ce-475f-9735-64f2b2a86846 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.418629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 403/785] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:15.424502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.424790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.425064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.443153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:15.444639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:15.526682 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 383/786] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:15.550963 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626e86c-59ce-475f-9735-64f2b2a86846 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:15.656725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626e86c-59ce-475f-9735-64f2b2a86846 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:15.689831 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:15.690664 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.690946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.691220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.691868 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:15.693232 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:15.706357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:15.707556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:15.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 404/787] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:15.714778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:15.837760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec23a-68b9-4c8f-8857-dde3499f2b0e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:15.871917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:15.873089 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:15.873089 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:15.873250 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:15.873888 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:15.874190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:15.875639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:15.881072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 384/788] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:15.886977 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:15.990690 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee2e4d-a1f0-40c1-bcd0-f381987d760a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:16.027688 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:16.028382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:16.028661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:16.028941 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:16.029685 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:16.029992 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:16.031508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564ef33-3ffe-4b67-be3e-b767014cac87 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:16.037335 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 405/789] 10.222.0.44 () {56 vars in 1114 bytes} [Thu May 12 16:40:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:16.044691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:16.144435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877fee3-65a9-4daa-81be-4f93a0352e0b None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:16.178175 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:16.178855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:16.179135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:16.179416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:16.180545 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:16.181916 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012d14-9ea6-49d7-b030-75f27c0b1f79 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:16.287800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 385/790] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:40:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:17.697303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737566f-36f4-4e42-a2e8-01775d3e6bb6 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:17.697836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737566f-36f4-4e42-a2e8-01775d3e6bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:17.697836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737566f-36f4-4e42-a2e8-01775d3e6bb6 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:17.699257 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 406/791] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:17.704586 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:17.704969 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:17.705208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:17.722079 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:17.723262 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:17.796376 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 386/792] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:40:17.820578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737566f-36f4-4e42-a2e8-01775d3e6bb6 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:17.925203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737566f-36f4-4e42-a2e8-01775d3e6bb6 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:17.959935 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:17.961266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:17.961646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:17.962138 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:17.962845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:17.964212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:17.976477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:17.977661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:17.978581 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 407/793] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:17.983825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:18.087490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36133-cdf4-4c00-8dc0-bd0683099663 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:18.121901 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:18.122592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:18.123023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:18.123305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:18.123998 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] RBAC: Adding query filter params (name=compute) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:18.124297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:18.125654 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab587f7-b80a-416c-957b-3c164c4c4cfe None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:18.131026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 387/794] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:18.137573 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:18.240946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12d620-c0e9-4857-bee0-24523af2b552 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:18.275634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:18.276309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:18.276589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:18.276861 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:18.277562 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:18.277864 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:18.279261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f79cf-85ea-461f-b1fb-11324138a157 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:18.283944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 408/795] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:18.645355 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050562-6285-4a76-b485-ea629dee937f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:18.645828 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050562-6285-4a76-b485-ea629dee937f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:18.646346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050562-6285-4a76-b485-ea629dee937f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:18.649403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 388/796] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:18.655800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:18.656290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:18.656770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:18.685365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:18.687357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:18.780681 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 409/797] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:18.805816 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af050562-6285-4a76-b485-ea629dee937f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:18.913530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af050562-6285-4a76-b485-ea629dee937f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:18.952853 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:18.953509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:18.953783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:18.954049 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:18.954785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:18.956210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:18.957562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING keystone.server.flask.common [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 16:40:19.001568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.sql.core [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:40:19.001568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 16:40:19.001568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [parameters: {'id': 'a5cc6b6fde324f2b8d1af0dadc736820', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 16:40:19.001568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5cc6b6fde324f2b8d1af0dadc736820.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5cc6b6fde324f2b8d1af0dadc736820. May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application conn.query(q) May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:40:19.019530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result.read() May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 16:40:19.020691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application next(self.gen) May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application yield resource May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application next(self.gen) May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.session.rollback() May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.force_reraise() May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise self.value May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application session.commit() May 12 16:40:19.027280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._prepare_impl() May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.session.flush() May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._flush(objects) May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application compat.raise_( May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application flush_context.execute() May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 16:40:19.028409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rec.execute(self) May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 16:40:19.029555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application conn.query(q) May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result.read() May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:40:19.030555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [parameters: {'id': 'a5cc6b6fde324f2b8d1af0dadc736820', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:19.031634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:19.032596 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5cc6b6fde324f2b8d1af0dadc736820. May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:19.034395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 389/798] 10.222.0.44 () {60 vars in 1140 bytes} [Thu May 12 16:40:18 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 16:40:19.035356 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:19.140628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f5d33-746f-446c-b182-b8316c441bae None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:19.175209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:19.175907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:19.176180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:19.176445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:19.183820 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:19.185235 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-6859ec82-35cb-4665-989d-8d833b1b5863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:40:19.199484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:19.200918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:19.202114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 410/799] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:19.206669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:19.314210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773e54c-11f1-4451-88c3-31e9eec71567 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:19.348494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:19.349213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:19.349487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:19.349759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:19.350542 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:19.350846 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:19.352480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd6ac-486a-46cf-a910-74348a315b7e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:19.372599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 390/800] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:40:20.672384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65ab9-ca0b-4fbc-a824-f1c2119c2d9f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:20.672972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65ab9-ca0b-4fbc-a824-f1c2119c2d9f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:20.672972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a65ab9-ca0b-4fbc-a824-f1c2119c2d9f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:20.674393 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 411/801] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:20.681042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e70bdd-319c-4d5f-bfbe-f4956914e4c5 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:20.681572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e70bdd-319c-4d5f-bfbe-f4956914e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:20.681665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e70bdd-319c-4d5f-bfbe-f4956914e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:20.699676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-04e70bdd-319c-4d5f-bfbe-f4956914e4c5 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:20.701231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-04e70bdd-319c-4d5f-bfbe-f4956914e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:20.774491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 391/802] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:20.799051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a65ab9-ca0b-4fbc-a824-f1c2119c2d9f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:20.908675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a65ab9-ca0b-4fbc-a824-f1c2119c2d9f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:20.949677 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:20.950297 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:20.950583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:20.950859 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:20.951566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:20.952935 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326205e2-0dfd-4dce-80d0-dc874892dcb6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:21.025475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 412/803] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:40:20 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:40:21.777921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c21cd-d957-4adb-9b27-ac37b021dd07 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:21.778488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c21cd-d957-4adb-9b27-ac37b021dd07 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:21.778488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c21cd-d957-4adb-9b27-ac37b021dd07 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:21.779873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 392/804] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:21.785521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e674-37dd-4316-994a-03ce2579017e None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:21.785998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e674-37dd-4316-994a-03ce2579017e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:21.786094 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e674-37dd-4316-994a-03ce2579017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:21.803126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-a821e674-37dd-4316-994a-03ce2579017e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:21.804898 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-a821e674-37dd-4316-994a-03ce2579017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:21.877833 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 413/805] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:21 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:21.904733 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c21cd-d957-4adb-9b27-ac37b021dd07 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:22.004257 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c21cd-d957-4adb-9b27-ac37b021dd07 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:22.038672 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:22.039857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:22.040138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:22.040413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:22.041102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:22.042555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:22.088187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.sql.core [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:40:22.088187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 16:40:22.088187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [parameters: {'user_id': '4405eba9d03b4257b636c753199c3d3e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 16:40:22.088187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application conn.query(q) May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result.read() May 12 16:40:22.095546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:40:22.096439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application next(self.gen) May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application yield resource May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application next(self.gen) May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.session.rollback() May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.force_reraise() May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise self.value May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application session.commit() May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 16:40:22.097398 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._prepare_impl() May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.session.flush() May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._flush(objects) May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application compat.raise_( May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application flush_context.execute() May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rec.execute(self) May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 16:40:22.098318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:40:22.099190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application conn.query(q) May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application result.read() May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:40:22.100035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [parameters: {'user_id': '4405eba9d03b4257b636c753199c3d3e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:22.100868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 16:40:22.102347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:22.103259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 393/806] 10.222.0.44 () {60 vars in 1131 bytes} [Thu May 12 16:40:21 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:22.103656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e674-37dd-4316-994a-03ce2579017e None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:22.200907 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e674-37dd-4316-994a-03ce2579017e None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:22.234126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:22.234944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:22.235230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:22.235510 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:22.242564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:22.243994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-87722131-8f7a-46b3-ad45-0888568786f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:40:22.258984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:22.259994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:22.260930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 414/807] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:40:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:22.266116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:22.363644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b9e5e-4d25-40f4-9251-fc9aedecf4a1 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:22.396317 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:22.396978 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:22.397257 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:22.397530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:22.399021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:22.399327 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:22.401068 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b404-1382-4cd3-932c-d4d1a7c0e011 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:22.438456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 394/808] 10.222.0.44 () {56 vars in 1101 bytes} [Thu May 12 16:40:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:23.361814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358e67-8437-48a8-96a6-66893e94e88d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:23.362376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358e67-8437-48a8-96a6-66893e94e88d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:23.362376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358e67-8437-48a8-96a6-66893e94e88d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:23.363728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 415/809] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:23.369783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:23.371166 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:23.371166 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:23.388171 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:23.389695 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:23.455211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 395/810] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:23 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:23.479270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358e67-8437-48a8-96a6-66893e94e88d None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:23.577708 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358e67-8437-48a8-96a6-66893e94e88d None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:23.610917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:23.611695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:23.612023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:23.612242 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] PATH_INFO: `/v3/services/compute` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:23.612877 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:23.614251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:23.625863 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:23.627067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:40:23.628305 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 416/811] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:23.633998 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:23.735946 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735739-6e6d-42f0-b95a-6871115c87db None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:23.768884 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:23.769549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:23.769829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:23.770106 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:23.770844 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:23.771150 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:23.772523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:23.777932 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 396/812] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:23.783708 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:23.879747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2d05d-1516-4eee-a255-48e99485805a None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:23.913395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:23.914107 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:23.914416 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:23.914694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:23.915392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:23.915696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:23.917046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:23.921665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 417/813] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:23.927686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:24.023480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413878d2-76cd-41f2-b976-3ba41a0f5962 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:24.056560 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:24.057210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:24.057491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:24.057766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:24.058587 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] RBAC: Adding query filter params (interface=public, service_id=3f3459c494484702af1015eb38487335, region_id=RegionOne) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:24.058898 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:24.060260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970dde0-44e9-4c9e-9b0d-9782dc3283f2 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:24.065194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 397/814] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:40:23 2022] GET /identity/v3/endpoints?service_id=3f3459c494484702af1015eb38487335&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:24.071007 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:24.166378 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99f8b-a93a-4e7c-a730-281caa51c2a5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:24.199457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:24.200112 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:24.200397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:24.200671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:24.201347 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:24.202743 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99173-ea30-43f7-8e9c-13d9cb8c9483 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:24.208786 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 418/815] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:40:24 2022] GET /identity/v3/services => generated 1728 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:40:26.494176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eb989-081e-4977-b581-c09bf09a8f72 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:26.500552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eb989-081e-4977-b581-c09bf09a8f72 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:26.500552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eb989-081e-4977-b581-c09bf09a8f72 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:26.500552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 398/816] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:40:26.502176 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:26.502614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:26.502798 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:26.520132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:40:26.521322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:40:26.584659 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 419/817] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:40:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:40:26.608627 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eb989-081e-4977-b581-c09bf09a8f72 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:26.704561 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eb989-081e-4977-b581-c09bf09a8f72 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:26.736283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:26.737055 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:26.737332 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:26.737600 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] PATH_INFO: `/v3/services/compute` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:26.738256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:26.739609 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:40:26.751131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:40:26.752507 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:40:26.753953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 399/818] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:40:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:40:26.759384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:26.857374 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804f7c6-5e3c-4a82-b7f6-aea68426c0b9 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:26.899308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:26.899972 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:26.900250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:26.900521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:26.901217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:26.901517 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:26.902906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:26.907523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 420/819] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:26.913179 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:27.007924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fcd63-3897-4fef-8867-73772823a63f None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:27.042796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:27.043455 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:27.043739 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:27.044016 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:27.044718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:40:27.045023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:27.046474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77ffc-8214-49ed-8e46-3f014bffe739 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:27.051463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 400/820] 10.222.0.44 () {56 vars in 1112 bytes} [Thu May 12 16:40:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:40:27.057828 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:40:27.154441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692d59-25a3-41ed-b343-1217968314bd None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:40:27.188082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a807777-7018-4085-b723-249bba6c225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:40:27.188742 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807777-7018-4085-b723-249bba6c225a None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:40:27.189025 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807777-7018-4085-b723-249bba6c225a None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:40:27.189301 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a807777-7018-4085-b723-249bba6c225a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:40:27.190031 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a807777-7018-4085-b723-249bba6c225a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:40:27.191479 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a807777-7018-4085-b723-249bba6c225a None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:40:27.316187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 421/821] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:40:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:41:57.627934 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031a5d-b93d-4ebf-920d-27c42d87a835 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:41:57.628581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031a5d-b93d-4ebf-920d-27c42d87a835 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:41:57.628581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031a5d-b93d-4ebf-920d-27c42d87a835 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:41:57.630162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 401/822] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:41:57.635891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:41:57.636414 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:41:57.636414 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:41:57.654389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:41:57.655539 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:41:57.733134 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 422/823] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:41:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:41:57.761467 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031a5d-b93d-4ebf-920d-27c42d87a835 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:41:57.867729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031a5d-b93d-4ebf-920d-27c42d87a835 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:41:57.903060 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:41:57.903779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:41:57.904065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:41:57.904343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:41:57.916522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:41:57.918026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:41:57.936387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:41:57.937565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:41:57.938984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:41:57.938984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:41:57.938984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:41:57.938984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:41:57.938984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 402/824] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:41:57.944322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:41:58.044386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc755ca-4f86-40cf-a509-7a1122dea787 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:41:58.079185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:41:58.079847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:41:58.080132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:41:58.080411 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:41:58.081128 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:41:58.081436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:41:58.083130 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff452c8-9866-4075-8550-e890bd354eef None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:41:58.094699 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 423/825] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:41:58.100653 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:41:58.212085 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6643-4a2f-4442-a6d1-6ab00d38f742 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:41:58.250752 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:41:58.251427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:41:58.251707 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:41:58.251984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:41:58.252686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:41:58.254174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a88c16-8b0f-4fec-83b5-025bd5797ce8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:41:58.475711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 403/826] 10.222.0.44 () {60 vars in 1132 bytes} [Thu May 12 16:41:58 2022] POST /identity/v3/users => generated 251 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:42:00.859002 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5e74-ab98-42b2-a865-63e7b3ad5d11 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:00.859693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5e74-ab98-42b2-a865-63e7b3ad5d11 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:00.859693 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5e74-ab98-42b2-a865-63e7b3ad5d11 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:00.861092 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 424/827] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:00.868028 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:00.868541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:00.868681 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:00.891776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:00.893039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:00.968568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 404/828] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:00.995534 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf5e74-ab98-42b2-a865-63e7b3ad5d11 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:01.107060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf5e74-ab98-42b2-a865-63e7b3ad5d11 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:01.153045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:01.153835 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:01.154111 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:01.154437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:01.170262 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:01.178352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:01.179678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:01.180705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 425/829] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:01.186451 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:01.287947 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b9aa7-7354-4357-87f0-92ede4491cac None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:01.323177 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:01.323839 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:01.324120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:01.324392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:01.325131 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:01.325432 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:01.326852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:01.337085 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 405/830] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:01.343047 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:01.481219 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a623d-1d7e-4f9d-90b1-6fb67653ceb4 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:01.532612 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:01.533428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:01.533694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:01.533969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:01.545968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:01.547508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:01.565698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:01.570371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:01.571995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:01.571995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:01.571995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:01.571995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:01.571995 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 426/831] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:01.573431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:01.671214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce77-3bd6-41f3-9fca-eb18d6c711ec None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:01.702953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:01.703591 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:01.703871 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:01.704143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:01.704864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:01.705168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:01.706566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:01.719488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 406/832] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:01.728218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:01.839439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea6bc-5624-4b64-9fd7-bd46ad1d6f3f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:01.875377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:01.876212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:01.876444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:01.876711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:01.886163 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:01.887638 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:01.902767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:01.904630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:01.906494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 427/833] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:01.910080 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:02.025914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1eb5-1d77-41ee-b8e2-7d89d78ede76 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:02.064340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:02.065021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:02.065304 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:02.065574 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:02.067650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:02.067967 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:02.069416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:02.088246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 407/834] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:02.094274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:02.211350 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254ff08-84bc-4642-a4f8-85f5a100cde5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:02.246969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:02.257569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:02.257569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:02.257569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:02.325760 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:02.327264 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:02.436999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 428/835] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:42:02 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:42:02.443930 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:02.545802 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f970c2-ed6e-40a3-8f1f-3d78ae861b56 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:02.594612 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:02.595711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:02.596213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:02.596695 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:02.609510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:02.611437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:02.632389 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:02.634234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:02.636454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:02.636454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:02.636454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:02.636454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:02.636454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 408/836] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:02.639674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:02.762039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3999e-3452-4eca-ba0f-bd2cc821f776 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:02.807430 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:02.808147 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:02.808431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:02.808712 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:02.809463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:02.809777 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:02.811457 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:02.826575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 429/837] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:02.833842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:02.959347 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e7f8-02de-42c3-9eaa-f6c3d675ef15 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:03.005682 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:03.007062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:03.007524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:03.007832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:03.018289 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:03.021738 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:03.039713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:03.045161 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:03.046641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 409/838] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:03.047542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:03.153397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0f2a-561b-4571-90b0-cb6052aab93f None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:03.187922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:03.188590 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:03.188878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:03.189157 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:03.189949 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:03.190290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:03.191749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bd119-eb42-47c1-8436-fec504983df4 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:03.204546 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 430/839] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:03.212164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:03.316473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e6f8-1613-4fae-b4d3-2c16b9982dd8 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:03.357741 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:03.358929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:03.359441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:03.359951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:03.372870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=12fdfcd0ace142d49be44ff2772425f8) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:03.372870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:03.372870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481a26-1bae-494b-bc4a-2fb7722cfe62 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:03.375255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 410/840] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:42:03 2022] GET /identity/v3/role_assignments?user.id=12fdfcd0ace142d49be44ff2772425f8&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:42:05.787975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d50-0a7d-475d-85bf-78a5093439bd None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:05.788509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d50-0a7d-475d-85bf-78a5093439bd None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:05.788509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549d50-0a7d-475d-85bf-78a5093439bd None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:05.789988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 431/841] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:05.796336 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:05.797876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:05.797876 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:05.815199 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:05.816940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:05.889577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 411/842] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:05.914807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549d50-0a7d-475d-85bf-78a5093439bd None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:06.052804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549d50-0a7d-475d-85bf-78a5093439bd None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:06.109362 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:06.110755 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:06.111238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:06.111721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:06.130668 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:06.144512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:06.146060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:06.152139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 432/843] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:06.153740 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:06.279974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1bdc4-f8cd-44c0-a262-d33b52204aa3 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:06.316970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:06.317641 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:06.317920 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:06.318238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:06.319149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] RBAC: Adding query filter params (name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:06.319476 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:06.321256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:06.334416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 412/844] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:06.341782 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:06.460812 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913c37-dc93-42cc-b022-26a52fd98acf None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:06.507192 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:06.508239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:06.508611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:06.508970 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:06.523802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:06.525859 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:06.551767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:06.565263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:06.566745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:06.566745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:06.566745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:06.566745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:06.566745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 433/845] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:06.567080 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:06.685441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44fee-8e79-4c8e-ad61-c04455bd0e27 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:06.724949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:06.747975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:06.748592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 413/846] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:42:06.752095 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:06.874767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4425a-1340-4b73-a67f-33248aca3f4b None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:06.912474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:06.913290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:06.913574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:06.913841 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:06.921987 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:06.923490 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:06.939314 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:06.942108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:06.943999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 434/847] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:06.947188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:07.052047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be17e23-241b-4656-b24e-e0ba06895e72 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:07.087468 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:07.088178 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:07.088491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:07.088767 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:07.089661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:07.089934 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:07.091498 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:07.111921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 414/848] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:07.118064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:07.248767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf511a5-8823-4b4c-9b75-d7b9a126b5c2 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:07.286252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:07.287212 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:07.287599 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:07.288039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:07.300880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:07.302655 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:07.321253 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:07.323091 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:07.324625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:07.324625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:07.324625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:07.324625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:07.324625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 435/849] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:07.330418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:07.448550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a6624-165e-4f44-a07f-8fb05788e75a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:07.484116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:07.484821 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:07.485097 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:07.485367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:07.486085 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:07.486409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:07.488333 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:07.501231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 415/850] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:07.510926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:07.676611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1973473-6f80-4dba-8eb5-f95d0560516c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:07.722938 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:07.723770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:07.724103 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:07.724423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:07.733624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:07.736080 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:07.756807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:07.757847 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:07.758924 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 436/851] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:07.764187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:07.873033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae17d-91f0-44dd-92f1-d858eb7feb49 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:07.909986 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:07.910737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:07.911062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:07.911362 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:07.912160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:07.912529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:07.914056 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9b05-a0d5-4383-b5fe-c69ac646da31 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:07.930622 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 416/852] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:07.935106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:08.044282 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d63e-31a3-4f46-904f-a82479984763 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:08.079220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:08.080110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:08.080392 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:08.080668 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/12fdfcd0ace142d49be44ff2772425f8/roles/9d94173db5164f44859abb0024cb58f6` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:08.095629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=12fdfcd0ace142d49be44ff2772425f8, role_id=9d94173db5164f44859abb0024cb58f6)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:08.097640 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4b4f4-2504-42fb-8a41-c1ef50502426 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:08.212395 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 437/853] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:42:07 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/12fdfcd0ace142d49be44ff2772425f8/roles/9d94173db5164f44859abb0024cb58f6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:42:10.692113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3aa7-88b1-4c5a-8d0c-163786bff3b2 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:10.692694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3aa7-88b1-4c5a-8d0c-163786bff3b2 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:10.692694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3aa7-88b1-4c5a-8d0c-163786bff3b2 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:10.693999 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 417/854] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:10.699357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:10.699814 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:10.699909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:10.717491 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:10.718742 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:10.789245 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 438/855] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:10.814524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3aa7-88b1-4c5a-8d0c-163786bff3b2 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:10.918779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3aa7-88b1-4c5a-8d0c-163786bff3b2 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:10.953532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:10.954275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:10.954562 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:10.954837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:10.965835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:10.974280 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:10.975435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:10.976331 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 418/856] 10.222.0.44 () {56 vars in 1102 bytes} [Thu May 12 16:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:10.982222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.087507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b1da2-2ada-4fc8-895d-270b267339d5 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:11.130122 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:11.130865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:11.131154 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:11.131441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:11.132216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] RBAC: Adding query filter params (name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:11.132531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:11.133991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:11.143181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 439/857] 10.222.0.44 () {56 vars in 1103 bytes} [Thu May 12 16:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:11.149128 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.261544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518453-95e7-41c3-91c0-8e47df0f1981 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:11.296258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:11.297046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:11.297328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:11.297605 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:11.308563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:11.309908 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:11.327526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:11.328657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:11.330123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:11.330123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:11.330123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:11.330123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:11.330123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 419/858] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:11.338318 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.439743 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae0381-7cd3-4553-a369-ae6ac1de5646 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:11.473715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:11.478377 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:11.490359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 440/859] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:11.496107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.598708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39958fb-735f-4378-b608-9fd31ce1eb04 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:11.632447 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:11.633208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:11.633483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:11.633754 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:11.641755 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:11.643367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:11.658893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:11.660919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:11.663174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 420/860] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:11.668071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.774631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0069-fc7b-4285-80f4-e23072a0bbf0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:11.832247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:11.833404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:11.833901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:11.834420 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:11.836007 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:11.836564 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:11.839269 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:11.871818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 441/861] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:11.877456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:11.986225 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b422d4-18fd-49ee-a443-d984796a1a1a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:12.021075 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:12.021703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:12.021980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:12.022278 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:12.088851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:12.090329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:12.192974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 421/862] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:42:11 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:42:12.198848 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:12.302996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443c9d-d124-468f-92a5-52de79cbbffe None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:12.337858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:12.339010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:12.339280 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:12.339546 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:12.351376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:12.352819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:12.371571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:12.372881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:12.373787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:12.373787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:12.373787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:12.373787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:12.373787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 442/863] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:12.379577 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:12.487465 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7560d-9410-4e00-8ce9-508a3bd9c8ae None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:12.522484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:12.523227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:12.523513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:12.523789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:12.524611 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:12.524914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:12.526322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:12.539327 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 422/864] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:12.545486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:12.662523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0a5d-3ecd-4265-b8e5-e966e861aef0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:12.698920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:12.699768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:12.700050 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:12.700353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:12.708132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:12.709723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:12.724524 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:12.725723 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:12.726879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 443/865] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:12.731663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:12.848835 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8596de-56da-45fb-a135-fce52d3fbad4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:12.883466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:12.884156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:12.884413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:12.884691 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:12.885473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:12.885777 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:12.887246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745bfe3-a0a2-42d9-aa0b-8cb623031c69 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:12.899642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 423/866] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:12.905789 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:13.010337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7163-1bc4-4fe7-a344-8b48b3154b29 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:13.045504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:13.046149 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:13.046462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:13.046731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:13.047543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] RBAC: Adding query filter params (role.id=9d94173db5164f44859abb0024cb58f6, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=12fdfcd0ace142d49be44ff2772425f8) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:13.047848 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:13.049259 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d83c-fa28-431f-99f3-546cc20fb768 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:13.055576 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 444/867] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:42:12 2022] GET /identity/v3/role_assignments?user.id=12fdfcd0ace142d49be44ff2772425f8&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=9d94173db5164f44859abb0024cb58f6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:15.602458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b9b2-41ce-4e4e-9356-47b4aa7fe800 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:15.603354 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b9b2-41ce-4e4e-9356-47b4aa7fe800 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:15.603354 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b9b2-41ce-4e4e-9356-47b4aa7fe800 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:15.604852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 424/868] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:42:15.611813 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:15.612424 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:15.613426 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:15.632464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:15.633677 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:15.709120 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 445/869] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:15.733937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9b9b2-41ce-4e4e-9356-47b4aa7fe800 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:15.859322 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9b9b2-41ce-4e4e-9356-47b4aa7fe800 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:15.902823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:15.903755 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:15.904150 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:15.904513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:15.917459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:15.925805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:15.927043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:15.928098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 425/870] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:15.933121 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:16.050802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2317662-0f73-4cb9-9033-abd2c1fd2cdc None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:16.107250 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:16.107932 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:16.108216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:16.108496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:16.109252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:16.109622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:16.110965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:16.120821 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 446/871] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:16.130867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:16.260784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5115aa-e09e-4352-9abf-e8b950c88b79 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:16.295144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:16.303862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:16.303862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:16.303862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:16.307715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:16.309188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:16.326753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:16.327837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:16.328950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:16.328950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:16.328950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:16.328950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:16.328950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 426/872] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:16.334083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:16.457705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac590db-bf56-4c77-b59f-b4ba432dadef None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:16.502011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:16.502709 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:16.503039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:16.503317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:16.504043 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:16.504344 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:16.505975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:16.518117 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 447/873] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:16.524941 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:16.642034 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38dcf7-2432-456a-9abb-a8548cf24a37 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:16.685604 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:16.686466 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:16.686744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:16.687020 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:16.706927 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:16.708588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:16.725771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:16.727918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:16.729588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 427/874] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:16.734819 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:16.843329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f895642-f3a3-4344-89e8-88841350f695 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:16.883996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:16.884671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:16.884953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:16.885227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:16.886061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:16.886409 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:16.887838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:16.905437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 448/875] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:16.911979 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:17.020893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3877b-c7fd-4116-931b-53b3e8ff6bb4 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:17.071863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:17.072546 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:17.072826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:17.073093 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:17.142833 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:17.144982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:17.251857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 428/876] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:42:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:42:17.259571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:17.363386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35685-1830-499f-af88-9f8577fd80d9 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:17.411266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:17.411266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:17.411266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:17.411266 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:17.420540 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:17.424150 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:17.445648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:17.456181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:17.457619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:17.457619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:17.457619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:17.457619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:17.457619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 449/877] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:17.457905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:17.559081 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c34a0-8fb6-4a1e-8fa0-75742fa33804 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:17.595735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:17.596393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:17.596717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:17.597494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:17.598283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:17.598586 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:17.599955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:17.614897 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 429/878] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:42:17.620462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:17.724448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5bdb-514f-41b1-8a0c-a6c90ebed72d None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:17.761036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:17.761827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:17.762106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:17.762407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:17.770261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:17.771724 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:17.785850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:17.788802 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:17.790608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 450/879] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:17.793810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:17.901177 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ec7ef-2220-49ba-a3f4-fc3f19e41b64 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:17.935112 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:17.935818 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:17.936093 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:17.936373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:17.937201 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:17.937502 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:17.938982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e5685-a09f-4583-a76b-f9e4b63e4067 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:17.952810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 430/880] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:17.959519 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:18.064084 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2753ca-8570-4f32-af5b-47c0408490b2 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:18.099308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:18.099967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:18.100247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:18.100526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:18.101353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=12fdfcd0ace142d49be44ff2772425f8) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:18.101661 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:18.103132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c533ca-9ef5-42c0-864c-ac2c107a4406 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:18.110025 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 451/881] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:42:17 2022] GET /identity/v3/role_assignments?user.id=12fdfcd0ace142d49be44ff2772425f8&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=5067df1fd41e4852bda05f53294ab802 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:20.441043 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251168a-aaf0-4c52-896a-93d942400709 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:20.441665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251168a-aaf0-4c52-896a-93d942400709 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:20.441665 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251168a-aaf0-4c52-896a-93d942400709 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:20.443059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 431/882] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:20.449617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:20.450681 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:20.450681 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:20.470496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:20.471698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:20.539059 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 452/883] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:42:20.563123 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251168a-aaf0-4c52-896a-93d942400709 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:20.670165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251168a-aaf0-4c52-896a-93d942400709 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:20.709358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:20.710064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:20.710378 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:20.710696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:20.722652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:20.730245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:20.731311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:20.732338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 432/884] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:20.739444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:20.841625 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17f7a-b120-4ef5-bfd7-6241512dbfdf None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:20.883626 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:20.884383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:20.884583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:20.884857 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:20.885613 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:20.885916 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:20.887335 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:20.897025 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 453/885] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:20.903042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.008436 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e723-39ac-411a-96ba-8172da04bad7 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.049326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.052062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.052345 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.052652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.063950 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.066086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:21.084513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:21.088137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:21.089186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:21.089186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:21.089186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:21.089186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:21.089186 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 433/886] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:21.091951 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.195716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e407a9-b9c9-4ae1-9dde-bbf46f68897c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.231355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.232022 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.232309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.232589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.233308 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:21.233617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.235026 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.247276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 454/887] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:42:21.253297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.355318 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5908f2-5372-4b8a-84a2-bedf3809cacf None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.389301 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.391526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.391526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.391526 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.400912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.402394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:21.417717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:21.432145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:21.433312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 434/888] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:21.434040 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.528675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded9a97-c51a-4e56-a864-e479cc5012e0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.562086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.562783 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.563066 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.563340 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.564180 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:21.564486 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.566474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.585565 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 455/889] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:21.591230 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.707842 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16edc3-836c-4da5-95ad-3044413bc7d5 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.742863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.743675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.743951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.744245 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.756393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.757850 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:21.775569 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:21.776709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:21.777656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:21.777656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:21.777656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:21.777656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:21.777656 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 435/890] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:21.782796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:21.890961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08635-1538-41ba-b9ff-93e4eac30b75 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:21.932052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:21.932846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:21.932976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:21.933243 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:21.934016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:21.934881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:21.935770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:21.947979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 456/891] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:21.953922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:22.059349 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb0800-d35f-44f6-8192-81eb8db42830 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:22.093481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:22.094285 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:22.094564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:22.094837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:22.102339 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:22.103787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:22.117937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:22.123793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:22.124955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 436/892] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:22.125552 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:22.256813 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27ab1-2f6d-4152-96f0-9c2692d1027c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:22.291355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:22.292019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:22.292298 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:22.292578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:22.293362 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:22.293669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:22.295151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db9b70-69bb-40c0-be04-b86fc0bf31f6 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:22.307542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 457/893] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:22.316550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:22.417306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae72cde-40b0-4bff-bdc2-ba8ba456a973 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:22.452501 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:22.453380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:22.453661 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:22.453933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] PATH_INFO: `/v3/projects/872992402bf54bed914e8e79adc26df1/users/12fdfcd0ace142d49be44ff2772425f8/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:22.456817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=872992402bf54bed914e8e79adc26df1, user_id=12fdfcd0ace142d49be44ff2772425f8, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:22.458403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0555550-7e77-4c5c-949e-d21224ad0c3b None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:22.566940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 437/894] 10.222.0.44 () {58 vars in 1439 bytes} [Thu May 12 16:42:22 2022] PUT /identity/v3/projects/872992402bf54bed914e8e79adc26df1/users/12fdfcd0ace142d49be44ff2772425f8/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:42:24.883754 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b63-5278-492c-83e5-78815d88cb0d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:24.884311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b63-5278-492c-83e5-78815d88cb0d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:24.884311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b63-5278-492c-83e5-78815d88cb0d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:24.885662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 458/895] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:24.891362 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:24.891926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:24.891926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:24.912238 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:24.913521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:24.986648 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 438/896] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:25.013277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0b63-5278-492c-83e5-78815d88cb0d None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:25.190678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0b63-5278-492c-83e5-78815d88cb0d None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:25.232958 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:25.233750 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:25.234030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:25.234338 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:25.244768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:42:25.252412 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:25.254379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:25.255506 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 459/897] 10.222.0.44 () {56 vars in 1096 bytes} [Thu May 12 16:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:25.260800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:25.367498 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bd64-3b70-474c-b926-f675f80cd165 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:25.401568 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:25.402312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:25.402675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:25.402949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:25.403692 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:25.403995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:25.405351 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:25.414188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 439/898] 10.222.0.44 () {56 vars in 1099 bytes} [Thu May 12 16:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:25.421119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:25.543915 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b4a8a-4a73-4540-ae31-45eadfc04d5c None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:25.594984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:25.597010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:25.598454 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:25.598976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:25.618362 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:25.619836 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:25.638034 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:25.639196 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:25.640114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:25.640114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:25.640114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:25.640114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:25.640114 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 460/899] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:25.646634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:25.761053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741344e4-ca22-427c-bdfe-94f2a9fa6c2e None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:25.804784 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:25.805382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:25.805660 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:25.805931 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:25.806710 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:25.807024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:25.808390 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:25.822311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 440/900] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:25.829875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:25.943711 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477d07-15f8-4d80-8db2-b305abffe959 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:25.978678 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:25.979480 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:25.979756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:25.986514 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:25.989498 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:25.990978 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:42:26.005860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:26.006975 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:26.008496 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 461/901] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:26.012848 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:26.123811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6aa95-886f-4102-953e-319a3b14f119 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:26.157017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:26.157748 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:26.158026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:26.158335 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:26.159803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:26.160112 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:26.161544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:26.179256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 441/902] 10.222.0.44 () {56 vars in 1143 bytes} [Thu May 12 16:42:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:26.185001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:26.281619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c90f4-1081-420a-8e6d-574cfcdfa4e0 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:26.316820 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:26.317477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:26.317762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:26.318042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:26.387379 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:26.388743 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:26.498300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 462/903] 10.222.0.44 () {58 vars in 1282 bytes} [Thu May 12 16:42:26 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:42:26.504638 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:26.612007 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fee4c-c40a-4dc2-b15e-3dbb79ba0f5a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:26.649487 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:26.650190 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:26.650497 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:26.650764 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:26.661528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:26.663004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:42:26.680647 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:26.681889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:26.688124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:42:26.688124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:42:26.688124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:42:26.688124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:26.688124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 442/904] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:26.688630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:26.794124 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a1e9b-ba5b-4f90-846a-829a7ea704ee None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:26.838816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:26.839507 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:26.839918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:26.840195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:26.840921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:26.841226 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:26.842624 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:26.855764 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 463/905] 10.222.0.44 () {56 vars in 1109 bytes} [Thu May 12 16:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:26.864948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:26.968440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9337da-ded1-4614-99b5-6fb9e7fec951 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:27.003939 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:27.004757 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:27.005310 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:27.005590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:27.012388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:27.013858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:42:27.037634 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application with Lock( May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:27.038788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:42:27.039885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: ERROR keystone.server.flask.application May 12 16:42:27.040351 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 443/906] 10.222.0.44 () {56 vars in 1111 bytes} [Thu May 12 16:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:27.046309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:27.154574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71455987-b4cd-4866-b7b7-5b86006e7564 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:27.188373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:27.189032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:27.189316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:27.189589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:27.190688 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:27.191001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:27.192464 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805d754-b787-4060-a7dd-fcb14d9e6109 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:27.204909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 464/907] 10.222.0.44 () {56 vars in 1148 bytes} [Thu May 12 16:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:27.213107 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:27.327084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414643d-8915-476a-a3be-6674fcd3d25a None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:27.361649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:27.363053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:27.363053 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:27.363353 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:27.364172 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] RBAC: Adding query filter params (role.id=5067df1fd41e4852bda05f53294ab802, scope.project.id=872992402bf54bed914e8e79adc26df1, user.id=12fdfcd0ace142d49be44ff2772425f8) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:27.364479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:27.365895 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62978e5-85b0-4085-8f1b-fcb5358447f7 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:27.371831 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 444/908] 10.222.0.44 () {56 vars in 1374 bytes} [Thu May 12 16:42:27 2022] GET /identity/v3/role_assignments?user.id=12fdfcd0ace142d49be44ff2772425f8&scope.project.id=872992402bf54bed914e8e79adc26df1&role.id=5067df1fd41e4852bda05f53294ab802 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:29.837628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d046-28c3-4cf5-b1d8-9413fa147490 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:29.838286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d046-28c3-4cf5-b1d8-9413fa147490 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:29.838286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d046-28c3-4cf5-b1d8-9413fa147490 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:29.839727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 465/909] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:29.845135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:29.846104 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:29.846104 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:29.863059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:29.864286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:29.950475 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 445/910] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:29.974006 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d046-28c3-4cf5-b1d8-9413fa147490 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:30.072950 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d046-28c3-4cf5-b1d8-9413fa147490 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:30.108641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:30.109345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:30.109623 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:30.109893 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:30.110595 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:30.112499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:30.124766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:30.134961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:30.135920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 466/911] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 12 16:42:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:30.136953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:30.242616 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752b11e-3f67-4f1e-bef8-6a75de1f357c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:30.277194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:30.277860 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:30.278142 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:30.278442 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:30.279147 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] RBAC: Adding query filter params (name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:30.279450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:30.280814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6ec76-e7bd-4dfe-a105-723d389b496e None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:30.286115 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 446/912] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 12 16:42:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:30.292048 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:30.393111 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb15b2-ce6e-43fb-905a-09feff85c1a5 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:30.427498 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:30.428150 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:30.428431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:30.428702 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] PATH_INFO: `/v3/services` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:30.429396 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] RBAC: Adding query filter params (type=placement) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:30.429698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:30.431113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2705da5-8b50-4c06-8f89-c33ef332c64b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:30.435712 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 467/913] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 12 16:42:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:32.837012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631a54-6304-499c-aa2b-4842676f2e60 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:32.837584 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631a54-6304-499c-aa2b-4842676f2e60 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:32.837584 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631a54-6304-499c-aa2b-4842676f2e60 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:32.838951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 447/914] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:32.844758 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c21b-3fc4-4aa4-affb-4001280e0a2f None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:32.845206 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c21b-3fc4-4aa4-affb-4001280e0a2f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:32.845391 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c21b-3fc4-4aa4-affb-4001280e0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:32.873766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-17c2c21b-3fc4-4aa4-affb-4001280e0a2f None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:32.875030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-17c2c21b-3fc4-4aa4-affb-4001280e0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:32.971481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 468/915] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:32.996733 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631a54-6304-499c-aa2b-4842676f2e60 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:33.100791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631a54-6304-499c-aa2b-4842676f2e60 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:33.135319 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:33.142015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:33.142015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:33.142015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:33.142015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:33.142015 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649a91-3d88-45d9-8d14-bc0124859c39 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:33.234270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 448/916] 10.222.0.44 () {60 vars in 1141 bytes} [Thu May 12 16:42:32 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:42:35.606454 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f090-d06b-4bae-9612-a9541282acb5 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:35.607027 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f090-d06b-4bae-9612-a9541282acb5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:35.607027 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f090-d06b-4bae-9612-a9541282acb5 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:35.608397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 469/917] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:35.614276 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:35.620994 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:35.620994 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:35.633326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:35.634585 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:35.707797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 449/918] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:35 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:35.731516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1f090-d06b-4bae-9612-a9541282acb5 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:35.833804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1f090-d06b-4bae-9612-a9541282acb5 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:35.866756 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:35.867476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:35.867767 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:35.868046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] PATH_INFO: `/v3/services/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:35.868704 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:35.870088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:35.883113 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:35.884357 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:35.885182 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 470/919] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 12 16:42:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:42:35.890856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:35.999642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edc866-4f2c-4a39-8129-36347dab0b36 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:36.032846 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:36.038013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:36.041529 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 450/920] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 12 16:42:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:36.047477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:36.149306 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894b578-3c03-48a7-8b93-d3360c470e2e None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:36.183815 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:36.184495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:36.184777 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:36.185053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:36.185861 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] RBAC: Adding query filter params (interface=public, service_id=ef0a5f59a4674f08b4a98178152ae9cc, region_id=RegionOne) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:36.186174 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:36.188727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bac324-8218-4651-84d6-18f477f6c98b None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:36.194383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 471/921] 10.222.0.44 () {56 vars in 1251 bytes} [Thu May 12 16:42:36 2022] GET /identity/v3/endpoints?service_id=ef0a5f59a4674f08b4a98178152ae9cc&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:36.200192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:36.302031 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba5c4-0885-4532-a983-99d170c44fd0 None admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:36.335946 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:36.336652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:36.336936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:36.337215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:36.337919 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:36.342399 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30527f5a-3cda-4e97-8079-1ffae0ea1684 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:36.346358 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 451/922] 10.222.0.44 () {56 vars in 1087 bytes} [Thu May 12 16:42:36 2022] GET /identity/v3/services => generated 1962 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:42:38.651901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907ab1-6f65-458f-94f5-73ce8f6e82b6 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:38.652481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907ab1-6f65-458f-94f5-73ce8f6e82b6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:38.652481 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907ab1-6f65-458f-94f5-73ce8f6e82b6 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:38.653899 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 472/923] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:42:38.660135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:38.660677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:38.660677 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:38.678182 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:42:38.679428 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:42:38.753470 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 452/924] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:42:38 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:42:38.779158 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a907ab1-6f65-458f-94f5-73ce8f6e82b6 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:38.898283 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a907ab1-6f65-458f-94f5-73ce8f6e82b6 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:38.933796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:38.934556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:38.934833 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:38.935108 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:38.935766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:38.937184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:42:38.950511 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:42:38.951826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application with Lock( May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self._enter() May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application return self.creator() May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application created_value = creator( May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: ERROR keystone.server.flask.application May 12 16:42:38.952665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 473/925] 10.222.0.44 () {56 vars in 1117 bytes} [Thu May 12 16:42:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:42:38.959042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:39.068972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927b42e-7ca6-49b1-9c34-24cfdfa6f847 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:39.106121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:39.106891 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:39.107173 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:39.107449 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] PATH_INFO: `/v3/services` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:39.108210 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:42:39.108519 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:39.109933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ed88f-c1fa-4b58-b932-3efed2a4dad0 None admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:39.116856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 453/926] 10.222.0.44 () {56 vars in 1116 bytes} [Thu May 12 16:42:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:42:39.122665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:42:39.233341 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f494fe-2c2a-4ac8-a8dd-86e589f0be57 None admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:42:39.271463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:42:39.272133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:42:39.272421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:42:39.272683 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:42:39.273435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:42:39.274852 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb6ffb-5c8d-4069-bd9f-b9c20b022515 None admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:42:39.400339 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 474/927] 10.222.0.44 () {60 vars in 1144 bytes} [Thu May 12 16:42:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:49:45.253870 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fdcc-33c1-4a03-ad91-8eb45c7353ea None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:45.254613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fdcc-33c1-4a03-ad91-8eb45c7353ea None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:45.254613 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fdcc-33c1-4a03-ad91-8eb45c7353ea None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:45.256054 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 454/928] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:45.261818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0c21-4e19-43a1-a590-db89c1f12396 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:45.262616 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0c21-4e19-43a1-a590-db89c1f12396 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:45.262616 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0c21-4e19-43a1-a590-db89c1f12396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:45.363652 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-154b0c21-4e19-43a1-a590-db89c1f12396 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:45.364938 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-154b0c21-4e19-43a1-a590-db89c1f12396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:45.501261 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 475/929] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:49:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:45.559966 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cb17-36ba-40ae-9f9f-ff6fc0d39869 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:45.560284 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cb17-36ba-40ae-9f9f-ff6fc0d39869 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:45.560520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cb17-36ba-40ae-9f9f-ff6fc0d39869 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:45.562508 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 455/930] 10.222.0.44 () {54 vars in 964 bytes} [Thu May 12 16:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:45.570801 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3aba-aa93-423f-acd6-8ca3fb01dbea None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:45.571339 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3aba-aa93-423f-acd6-8ca3fb01dbea None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:45.572441 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3aba-aa93-423f-acd6-8ca3fb01dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:45.666394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-384f3aba-aa93-423f-acd6-8ca3fb01dbea None None] MFA Rules not processed for user `defbe1cd07004860a20a4370f03ff612`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:45.669404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-384f3aba-aa93-423f-acd6-8ca3fb01dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:45.777613 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 476/931] 10.222.0.44 () {58 vars in 1061 bytes} [Thu May 12 16:49:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:45.778326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1cb17-36ba-40ae-9f9f-ff6fc0d39869 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:49:45.793307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1cb17-36ba-40ae-9f9f-ff6fc0d39869 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:49:45.805658 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:49:45.806561 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:45.806846 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:45.807547 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:45.819059 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:49:45.820652 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45c3a8-caaa-4e6a-8e2d-c827553c294f service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:49:45.832390 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 456/932] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:49:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:49:48.802333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47a3a1-9e29-424f-b12c-d240b3967b91 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:48.803149 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47a3a1-9e29-424f-b12c-d240b3967b91 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:48.803301 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47a3a1-9e29-424f-b12c-d240b3967b91 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:48.806078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 477/933] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:49:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:48.816791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44af9-2f13-427b-93e1-0a87702be354 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:48.817718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44af9-2f13-427b-93e1-0a87702be354 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:48.817718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44af9-2f13-427b-93e1-0a87702be354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:48.857459 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-75f44af9-2f13-427b-93e1-0a87702be354 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:48.860213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-75f44af9-2f13-427b-93e1-0a87702be354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:48.895825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 457/934] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:49:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:48.957509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47a3a1-9e29-424f-b12c-d240b3967b91 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:49:48.970296 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47a3a1-9e29-424f-b12c-d240b3967b91 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:49:48.974560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:49:48.975251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:48.975568 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:48.975824 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:48.987734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:49:48.989388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea6fd-78d0-40b5-995e-d1e0c746cded service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:49:49.002375 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 478/935] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:49:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:49:52.186116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab7de-1a8e-4fb2-8ac5-bc88ca21a38d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:52.186799 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab7de-1a8e-4fb2-8ac5-bc88ca21a38d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:52.186915 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab7de-1a8e-4fb2-8ac5-bc88ca21a38d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:52.188392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 458/936] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:52.194285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698f6a-f21e-4332-8e87-47ad53e29432 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:52.194806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698f6a-f21e-4332-8e87-47ad53e29432 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:52.194970 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698f6a-f21e-4332-8e87-47ad53e29432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:52.254664 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-7d698f6a-f21e-4332-8e87-47ad53e29432 None None] MFA Rules not processed for user `40d2b8384f224aedb6470ca4777a83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:52.255894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7d698f6a-f21e-4332-8e87-47ad53e29432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:52.361846 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 479/937] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:49:52 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:52.437153 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904ffe-03bf-4712-98bf-75c45c398508 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:52.437489 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904ffe-03bf-4712-98bf-75c45c398508 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:52.437874 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904ffe-03bf-4712-98bf-75c45c398508 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:52.439557 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 459/938] 10.222.0.44 () {54 vars in 964 bytes} [Thu May 12 16:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:52.447148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a21e-799a-4707-8d68-158f0ac114d6 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:52.447439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a21e-799a-4707-8d68-158f0ac114d6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:52.447830 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a21e-799a-4707-8d68-158f0ac114d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:52.473019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-a305a21e-799a-4707-8d68-158f0ac114d6 None None] MFA Rules not processed for user `defbe1cd07004860a20a4370f03ff612`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:52.474399 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-a305a21e-799a-4707-8d68-158f0ac114d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:52.482640 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 480/939] 10.222.0.44 () {58 vars in 1061 bytes} [Thu May 12 16:49:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:52.493099 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904ffe-03bf-4712-98bf-75c45c398508 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:49:52.518534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904ffe-03bf-4712-98bf-75c45c398508 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:49:52.518534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:49:52.518534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:52.518534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:52.519237 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:52.521460 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:49:52.523039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c026d-63b1-4f16-a423-52d9a272f0e6 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:49:52.534980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 460/940] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:49:52 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:49:56.411389 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e6ea-ce3c-4f34-8381-872f00869c50 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:56.411964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e6ea-ce3c-4f34-8381-872f00869c50 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:56.411964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e6ea-ce3c-4f34-8381-872f00869c50 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:56.413303 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 481/941] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:49:56.419473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fcaf5-c885-494c-9f1b-6ec74b064872 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:56.419938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fcaf5-c885-494c-9f1b-6ec74b064872 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:56.420039 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fcaf5-c885-494c-9f1b-6ec74b064872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:56.437946 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-c63fcaf5-c885-494c-9f1b-6ec74b064872 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:49:56.439194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-c63fcaf5-c885-494c-9f1b-6ec74b064872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:49:56.508777 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 461/942] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:49:56 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:49:56.549011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e6ea-ce3c-4f34-8381-872f00869c50 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:49:56.561869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e6ea-ce3c-4f34-8381-872f00869c50 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:49:56.565474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:49:56.566118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:49:56.566437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:49:56.566715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:49:56.583630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:49:56.585069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ed0f8-860d-467e-b07b-6b7192fe6d97 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:49:56.594812 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 482/943] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:49:56 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:00.486479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15df6-5abf-4677-96c0-f92dbfafb820 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:00.487021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15df6-5abf-4677-96c0-f92dbfafb820 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:00.487021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e15df6-5abf-4677-96c0-f92dbfafb820 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:00.488419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 462/944] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:00.494381 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723f8c-fae4-404f-b48c-814f2383be44 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:00.494926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723f8c-fae4-404f-b48c-814f2383be44 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:00.494926 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723f8c-fae4-404f-b48c-814f2383be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:00.512839 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f2723f8c-fae4-404f-b48c-814f2383be44 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:00.514042 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f2723f8c-fae4-404f-b48c-814f2383be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:00.521921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 483/945] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:00.561831 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e15df6-5abf-4677-96c0-f92dbfafb820 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:00.572669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e15df6-5abf-4677-96c0-f92dbfafb820 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:00.576042 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:00.576663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:00.577344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:00.577622 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:00.586450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:00.589096 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4091242-f02c-4533-9fb7-8f3ebc0c3f36 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:00.598858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 463/946] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:02.977309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6f3-c057-48e2-9779-3b9fc0e13003 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:02.977903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6f3-c057-48e2-9779-3b9fc0e13003 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:02.977903 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef6f3-c057-48e2-9779-3b9fc0e13003 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:02.979216 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 484/947] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:02.984417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7feeb-6799-489a-b924-47d0c2db3ee1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:02.984809 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7feeb-6799-489a-b924-47d0c2db3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:02.984973 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7feeb-6799-489a-b924-47d0c2db3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:03.005008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a5b7feeb-6799-489a-b924-47d0c2db3ee1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:03.006258 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a5b7feeb-6799-489a-b924-47d0c2db3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:03.015340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 464/948] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:03.053505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef6f3-c057-48e2-9779-3b9fc0e13003 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:03.076390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef6f3-c057-48e2-9779-3b9fc0e13003 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:03.083309 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:03.084427 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:03.084940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:03.085440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:03.109146 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:03.112100 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d196667-93bd-4f22-bc55-595ead0373ca service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:03.130721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 485/949] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:05.591627 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece326-b7c4-42d2-9e5b-e18177624f72 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:05.592206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece326-b7c4-42d2-9e5b-e18177624f72 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:05.592206 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ece326-b7c4-42d2-9e5b-e18177624f72 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:05.594098 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 465/950] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:05.599505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6703f-ac18-4833-86a4-0748afc5e65e None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:05.600038 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6703f-ac18-4833-86a4-0748afc5e65e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:05.600190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6703f-ac18-4833-86a4-0748afc5e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:05.620184 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-7dd6703f-ac18-4833-86a4-0748afc5e65e None None] MFA Rules not processed for user `40d2b8384f224aedb6470ca4777a83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:05.621390 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7dd6703f-ac18-4833-86a4-0748afc5e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:05.629739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 486/951] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:05 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:05.690697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece326-b7c4-42d2-9e5b-e18177624f72 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:05.702379 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ece326-b7c4-42d2-9e5b-e18177624f72 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:05.706036 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:05.706707 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:05.706991 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:05.707326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:05.716721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:05.718150 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154beb6-5824-4706-bbd1-a842dbae2e01 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:05.727879 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 466/952] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:05 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:08.588300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdf85-baaa-416d-948f-d95b4d380515 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:08.588865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdf85-baaa-416d-948f-d95b4d380515 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:08.588865 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdf85-baaa-416d-948f-d95b4d380515 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:08.590223 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 487/953] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:08.595778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f1f2-622f-4bfc-8fb6-525e6c4cab53 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:08.596307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f1f2-622f-4bfc-8fb6-525e6c4cab53 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:08.596412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f1f2-622f-4bfc-8fb6-525e6c4cab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:08.614824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-6cd5f1f2-622f-4bfc-8fb6-525e6c4cab53 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:08.616036 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-6cd5f1f2-622f-4bfc-8fb6-525e6c4cab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:08.624552 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 467/954] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:08.663025 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfdf85-baaa-416d-948f-d95b4d380515 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:08.675316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfdf85-baaa-416d-948f-d95b4d380515 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:08.678770 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:08.679422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:08.679700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:08.680115 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:08.691143 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:08.692599 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e55efb-91f3-41ad-a7d7-cdf2fcfc4976 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:08.702877 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 488/955] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:50:11.120442 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9549b-b363-423c-ac63-f80d8cfe7242 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:11.120922 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9549b-b363-423c-ac63-f80d8cfe7242 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:11.121001 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9549b-b363-423c-ac63-f80d8cfe7242 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:11.122716 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 468/956] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:11.128596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbab8-c571-4c21-900f-fb9c223a1742 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:11.129109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbab8-c571-4c21-900f-fb9c223a1742 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:11.129191 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbab8-c571-4c21-900f-fb9c223a1742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:11.151675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f2bbbab8-c571-4c21-900f-fb9c223a1742 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:11.153000 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f2bbbab8-c571-4c21-900f-fb9c223a1742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:11.161328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 489/957] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:11.201987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9549b-b363-423c-ac63-f80d8cfe7242 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:11.214708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9549b-b363-423c-ac63-f80d8cfe7242 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:11.218669 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:11.219393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:11.219746 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:11.220095 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:11.230763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:11.232342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a563-cac9-49c6-9562-4dda798ea0f5 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:11.248796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 469/958] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:14.405973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b784a8-b842-49aa-82e9-137e78ec7f5e None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:14.406531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b784a8-b842-49aa-82e9-137e78ec7f5e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:14.406531 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b784a8-b842-49aa-82e9-137e78ec7f5e None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:14.407914 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 490/959] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:14.413270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92272524-2350-4f96-b70b-97a31ddc6210 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:14.413737 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92272524-2350-4f96-b70b-97a31ddc6210 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:14.413840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92272524-2350-4f96-b70b-97a31ddc6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:14.432755 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-92272524-2350-4f96-b70b-97a31ddc6210 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:14.433992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-92272524-2350-4f96-b70b-97a31ddc6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:14.441918 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 470/960] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:14 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:14.479081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b784a8-b842-49aa-82e9-137e78ec7f5e None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:14.489670 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b784a8-b842-49aa-82e9-137e78ec7f5e None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:14.494342 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:14.494780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:14.495060 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:14.495333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:14.505188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:14.506665 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb364fdd-cdd1-46f2-9ece-fdeee1923886 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:14.516940 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 491/961] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:14 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:19.282805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346dd1-ff20-48e6-8f73-7ea2eac09f59 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:19.283372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346dd1-ff20-48e6-8f73-7ea2eac09f59 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:19.283512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346dd1-ff20-48e6-8f73-7ea2eac09f59 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:19.285769 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 471/962] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:19.291543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936e0f-eeca-4863-8893-4b07b0ac02d2 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:19.292044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936e0f-eeca-4863-8893-4b07b0ac02d2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:19.292135 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50936e0f-eeca-4863-8893-4b07b0ac02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:19.311585 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-50936e0f-eeca-4863-8893-4b07b0ac02d2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:19.312810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-50936e0f-eeca-4863-8893-4b07b0ac02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:19.322158 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 492/963] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:19.363194 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346dd1-ff20-48e6-8f73-7ea2eac09f59 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:19.374817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346dd1-ff20-48e6-8f73-7ea2eac09f59 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:19.378384 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:19.379031 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:19.379312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:19.379588 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:19.390531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:19.392021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626b2e-7a9a-4a53-8aba-c30297029d0c service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:19.402464 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 472/964] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:22.752532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768bd-cb26-42d5-8150-6a048d76f46c None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:22.753106 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768bd-cb26-42d5-8150-6a048d76f46c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:22.753727 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768bd-cb26-42d5-8150-6a048d76f46c None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:22.756466 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 493/965] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:22.764448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e381ad-0394-4a53-b122-726369bb5db0 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:22.764981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e381ad-0394-4a53-b122-726369bb5db0 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:22.765146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e381ad-0394-4a53-b122-726369bb5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:22.784494 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-c8e381ad-0394-4a53-b122-726369bb5db0 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:22.785799 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-c8e381ad-0394-4a53-b122-726369bb5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:22.794534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 473/966] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:22 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:22.833532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529768bd-cb26-42d5-8150-6a048d76f46c None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:22.848709 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529768bd-cb26-42d5-8150-6a048d76f46c None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:22.852973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:22.853630 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:22.853905 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:22.854168 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:22.864572 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:22.865950 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe5d30-882a-40fb-b9d1-355c445e6ff4 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:22.877408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 494/967] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:22 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:28.556385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967b2a-b385-4152-9381-0ce59620278b None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:28.556968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967b2a-b385-4152-9381-0ce59620278b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:28.556968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967b2a-b385-4152-9381-0ce59620278b None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:28.558543 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 474/968] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:28.563837 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7efd7-ca3c-44ff-8ca1-5a3a4e4ed94d None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:28.564302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7efd7-ca3c-44ff-8ca1-5a3a4e4ed94d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:28.564566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7efd7-ca3c-44ff-8ca1-5a3a4e4ed94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:28.583728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-72f7efd7-ca3c-44ff-8ca1-5a3a4e4ed94d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:28.584968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-72f7efd7-ca3c-44ff-8ca1-5a3a4e4ed94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:28.593666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 495/969] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:28.635155 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967b2a-b385-4152-9381-0ce59620278b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:28.646709 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967b2a-b385-4152-9381-0ce59620278b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:28.651259 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:28.652004 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:28.652437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:28.652777 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:28.662629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:28.664644 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2966975-9968-4ed5-8c4f-dd27df7688d2 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:28.675286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 475/970] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:50:34.547036 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb2c9-239f-4973-a663-e20d5645dafe None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:34.547856 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb2c9-239f-4973-a663-e20d5645dafe None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:34.548136 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb2c9-239f-4973-a663-e20d5645dafe None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:34.549705 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 496/971] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 16:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:34.555012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a840d-f20e-4898-8061-e3197ddf4760 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:34.555463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a840d-f20e-4898-8061-e3197ddf4760 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:34.555561 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a840d-f20e-4898-8061-e3197ddf4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:34.610100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a11a840d-f20e-4898-8061-e3197ddf4760 None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:34.612215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a11a840d-f20e-4898-8061-e3197ddf4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:34.746944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 476/972] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 16:50:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:39.498827 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847edfa-df05-4a44-8d03-d74bb9b90cf7 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:39.499512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847edfa-df05-4a44-8d03-d74bb9b90cf7 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:39.499512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847edfa-df05-4a44-8d03-d74bb9b90cf7 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:39.501126 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 497/973] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 16:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:39.509938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb53b1-61ef-4fb6-abe7-64e740112dca None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:39.510659 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb53b1-61ef-4fb6-abe7-64e740112dca None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:39.511041 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb53b1-61ef-4fb6-abe7-64e740112dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:39.531758 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-4dfb53b1-61ef-4fb6-abe7-64e740112dca None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:39.533330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-4dfb53b1-61ef-4fb6-abe7-64e740112dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:39.542620 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 477/974] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 16:50:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:40.931460 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30386-7477-47b8-b3ed-9f3ce84ab0d2 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:40.932168 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30386-7477-47b8-b3ed-9f3ce84ab0d2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:40.932168 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30386-7477-47b8-b3ed-9f3ce84ab0d2 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:40.933502 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 498/975] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 16:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:40.942270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5471-29fd-4158-9ab3-7a5daef01300 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:40.943114 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5471-29fd-4158-9ab3-7a5daef01300 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:40.943844 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5471-29fd-4158-9ab3-7a5daef01300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:40.966554 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-30dd5471-29fd-4158-9ab3-7a5daef01300 None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:40.968109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-30dd5471-29fd-4158-9ab3-7a5daef01300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:40.977550 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 478/976] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 16:50:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:45.079793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cf3e-125b-407a-b1b6-90a06e789c8e None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:45.080458 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cf3e-125b-407a-b1b6-90a06e789c8e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:45.080458 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cf3e-125b-407a-b1b6-90a06e789c8e None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:45.081843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 499/977] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:45.088811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891787-925e-4236-8d1f-b8ba3d3e4d89 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:45.089360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891787-925e-4236-8d1f-b8ba3d3e4d89 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:45.089901 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891787-925e-4236-8d1f-b8ba3d3e4d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:45.112086 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-4a891787-925e-4236-8d1f-b8ba3d3e4d89 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:45.114065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-4a891787-925e-4236-8d1f-b8ba3d3e4d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:45.123929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 479/978] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:45.191567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20125-cb12-4258-a836-e4beeef8a724 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:45.191851 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20125-cb12-4258-a836-e4beeef8a724 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:45.192431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20125-cb12-4258-a836-e4beeef8a724 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:45.193788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 500/979] 10.222.0.44 () {54 vars in 961 bytes} [Thu May 12 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:45.199926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281589ea-5c24-49ad-81ed-4a4430906dae None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:45.200431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281589ea-5c24-49ad-81ed-4a4430906dae None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:45.200953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281589ea-5c24-49ad-81ed-4a4430906dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:45.265419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-281589ea-5c24-49ad-81ed-4a4430906dae None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:45.268344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-281589ea-5c24-49ad-81ed-4a4430906dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:45.402942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 480/980] 10.222.0.44 () {58 vars in 1058 bytes} [Thu May 12 16:50:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:45.419762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20125-cb12-4258-a836-e4beeef8a724 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:45.446686 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20125-cb12-4258-a836-e4beeef8a724 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:45.456227 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:45.457548 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:45.458139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:45.458776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:45.478631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:45.481946 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a953d-8cc9-47a9-9dc3-5f87a52759e3 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:45.511318 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 501/981] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:48.237601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751c07-4747-47b4-8a36-c5273d117dfc None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:48.238154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751c07-4747-47b4-8a36-c5273d117dfc None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:48.238154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58751c07-4747-47b4-8a36-c5273d117dfc None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:48.239706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 481/982] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:48.245082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316820-d0ba-4611-97a1-eb3e0882a35a None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:48.245553 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316820-d0ba-4611-97a1-eb3e0882a35a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:48.245643 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e316820-d0ba-4611-97a1-eb3e0882a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:48.264994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-8e316820-d0ba-4611-97a1-eb3e0882a35a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:48.266224 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-8e316820-d0ba-4611-97a1-eb3e0882a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:48.275688 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 502/983] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:48.325394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58751c07-4747-47b4-8a36-c5273d117dfc None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:48.339831 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58751c07-4747-47b4-8a36-c5273d117dfc None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:48.345052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:48.345822 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:48.346222 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:48.346617 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:48.355345 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:48.357069 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0077e99-ff67-4ff2-8872-c710bc6a23eb service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:48.367260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 482/984] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:51.170776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66dcb-e327-449d-b37d-e65b8b3418b1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:51.171669 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66dcb-e327-449d-b37d-e65b8b3418b1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:51.172101 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66dcb-e327-449d-b37d-e65b8b3418b1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:51.173879 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 503/985] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:51.181236 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402efd3-e70e-4e2f-b959-d6fc1386d7cf None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:51.182286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402efd3-e70e-4e2f-b959-d6fc1386d7cf None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:51.182781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402efd3-e70e-4e2f-b959-d6fc1386d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:51.202618 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-9402efd3-e70e-4e2f-b959-d6fc1386d7cf None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:51.204263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-9402efd3-e70e-4e2f-b959-d6fc1386d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:51.212906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 483/986] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:51.269075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7f58-cb6d-4e6a-bea2-3b5091ff4ea6 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:51.269701 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7f58-cb6d-4e6a-bea2-3b5091ff4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:51.270322 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7f58-cb6d-4e6a-bea2-3b5091ff4ea6 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:51.272909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 504/987] 10.222.0.44 () {54 vars in 961 bytes} [Thu May 12 16:50:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:51.281747 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9abb4-05e9-48fc-96cb-47ec5ee84e98 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:51.282028 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9abb4-05e9-48fc-96cb-47ec5ee84e98 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:51.282357 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9abb4-05e9-48fc-96cb-47ec5ee84e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:51.305212 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d0b9abb4-05e9-48fc-96cb-47ec5ee84e98 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:51.307452 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d0b9abb4-05e9-48fc-96cb-47ec5ee84e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:51.325384 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 484/988] 10.222.0.44 () {58 vars in 1058 bytes} [Thu May 12 16:50:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:50:51.333334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7f58-cb6d-4e6a-bea2-3b5091ff4ea6 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:51.348203 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7f58-cb6d-4e6a-bea2-3b5091ff4ea6 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:51.355153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378809-eda7-4357-9610-d76705239260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:51.355153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378809-eda7-4357-9610-d76705239260 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:51.355153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378809-eda7-4357-9610-d76705239260 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:51.355153 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378809-eda7-4357-9610-d76705239260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:51.363248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378809-eda7-4357-9610-d76705239260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:51.364842 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31378809-eda7-4357-9610-d76705239260 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:51.375228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 505/989] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:54.052306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e066-92e9-46ff-b1d2-e540ef05aab8 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:54.053541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e066-92e9-46ff-b1d2-e540ef05aab8 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:54.054041 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e066-92e9-46ff-b1d2-e540ef05aab8 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:54.055703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 485/990] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:50:54.061608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9632e8-9599-4460-84e7-a883091c1765 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:54.062585 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9632e8-9599-4460-84e7-a883091c1765 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:54.063078 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9632e8-9599-4460-84e7-a883091c1765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:54.087731 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ab9632e8-9599-4460-84e7-a883091c1765 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:54.089295 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ab9632e8-9599-4460-84e7-a883091c1765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:54.106149 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 506/991] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:54.152394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e066-92e9-46ff-b1d2-e540ef05aab8 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:54.169330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e066-92e9-46ff-b1d2-e540ef05aab8 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:54.175944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:54.176188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:54.176682 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:54.177152 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:54.187324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:54.189531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b82c29-2f8b-49c9-9bc2-5853ead51311 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:54.216981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 486/992] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:56.034346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ed0b-453d-49cc-9d89-26c7b31a1dfa None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:56.034909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ed0b-453d-49cc-9d89-26c7b31a1dfa None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:56.034909 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ed0b-453d-49cc-9d89-26c7b31a1dfa None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:56.036252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 507/993] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:56.043242 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9245eb-f0f9-495f-9b09-3cca768c1891 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:56.043718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9245eb-f0f9-495f-9b09-3cca768c1891 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:56.043797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9245eb-f0f9-495f-9b09-3cca768c1891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:56.063063 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-2b9245eb-f0f9-495f-9b09-3cca768c1891 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:56.064187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-2b9245eb-f0f9-495f-9b09-3cca768c1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:56.072164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 487/994] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:56.392274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a085db-2b40-49c9-884c-da4fe6882006 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:56.392274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a085db-2b40-49c9-884c-da4fe6882006 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:56.392274 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a085db-2b40-49c9-884c-da4fe6882006 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:56.394421 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 508/995] 10.222.0.44 () {54 vars in 963 bytes} [Thu May 12 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:56.400405 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53a8d-0ed4-4883-bddd-90188719d867 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:56.400790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53a8d-0ed4-4883-bddd-90188719d867 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:56.401142 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53a8d-0ed4-4883-bddd-90188719d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:56.451717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0eb53a8d-0ed4-4883-bddd-90188719d867 None None] MFA Rules not processed for user `c91e736aa84b449bb0657de099a88ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:56.453030 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0eb53a8d-0ed4-4883-bddd-90188719d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:56.519776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 488/996] 10.222.0.44 () {58 vars in 1060 bytes} [Thu May 12 16:50:56 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:56.527870 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a085db-2b40-49c9-884c-da4fe6882006 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:56.541860 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a085db-2b40-49c9-884c-da4fe6882006 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:56.545482 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91e736aa84b449bb0657de099a88ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:56.546223 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:56.546574 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:56.546915 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:56.562715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:56.564328 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8deba3-f95c-4a6d-91e9-c41e8749afb8 service cinder] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:56.576598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 509/997] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:50:57.024688 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc698-a816-4a17-8d5f-ba81c33855fa None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:57.024979 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc698-a816-4a17-8d5f-ba81c33855fa None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:57.025265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebc698-a816-4a17-8d5f-ba81c33855fa None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:57.026829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 489/998] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:57.031910 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa0ea-6b77-42e1-bcc7-6b4f42bd8dd2 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:57.032195 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa0ea-6b77-42e1-bcc7-6b4f42bd8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:57.032469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baa0ea-6b77-42e1-bcc7-6b4f42bd8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:57.051696 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f7baa0ea-6b77-42e1-bcc7-6b4f42bd8dd2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:57.054001 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f7baa0ea-6b77-42e1-bcc7-6b4f42bd8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:57.070230 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 510/999] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:57.125593 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebc698-a816-4a17-8d5f-ba81c33855fa None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:57.141016 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebc698-a816-4a17-8d5f-ba81c33855fa None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:57.146234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:57.147473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:57.147687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:57.148073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:57.158135 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:57.159885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152dd34-fb52-4f6b-9c4a-6862a8bc37dc service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:57.174137 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 490/1000] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:50:59.743637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a456b5-ea64-4364-b619-e829da0574f6 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:59.744225 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a456b5-ea64-4364-b619-e829da0574f6 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:59.744225 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a456b5-ea64-4364-b619-e829da0574f6 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:59.745548 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 511/1001] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:50:59.751392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3e03-a266-4475-bbdb-0027016f1980 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:59.751851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3e03-a266-4475-bbdb-0027016f1980 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:59.751972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3e03-a266-4475-bbdb-0027016f1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:59.775424 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-e6bc3e03-a266-4475-bbdb-0027016f1980 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:50:59.777196 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-e6bc3e03-a266-4475-bbdb-0027016f1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:50:59.785572 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 491/1002] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:50:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:50:59.833010 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a456b5-ea64-4364-b619-e829da0574f6 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:50:59.849158 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a456b5-ea64-4364-b619-e829da0574f6 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:50:59.856440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:50:59.857443 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:50:59.857735 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:50:59.858014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:50:59.867980 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:50:59.870016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91872f9-9270-43b0-a9e6-ad31c99900f3 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:50:59.881011 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 512/1003] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:50:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:02.502247 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ab39-352f-4659-adec-f8b2803607ea None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:02.502893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ab39-352f-4659-adec-f8b2803607ea None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:02.503105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ab39-352f-4659-adec-f8b2803607ea None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:02.505413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 492/1004] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:02.513673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ec89-250f-421c-a319-27d9ba660a60 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:02.514131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ec89-250f-421c-a319-27d9ba660a60 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:02.514530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ec89-250f-421c-a319-27d9ba660a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:02.539935 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ec26ec89-250f-421c-a319-27d9ba660a60 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:02.541449 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ec26ec89-250f-421c-a319-27d9ba660a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:02.552348 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 513/1005] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:02.605445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2ab39-352f-4659-adec-f8b2803607ea None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:02.619807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2ab39-352f-4659-adec-f8b2803607ea None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:02.624794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:02.625555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:02.625939 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:02.626328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:02.635511 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:02.637205 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c025d38-454c-4ba9-aa93-8263a531e681 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:02.648372 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 493/1006] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:05.093713 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828639e-7bde-4c54-bf42-c916eebbfd7c None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:05.094272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828639e-7bde-4c54-bf42-c916eebbfd7c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:05.094355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828639e-7bde-4c54-bf42-c916eebbfd7c None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:05.103065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921b1c-0741-42c6-bd58-bd8ee0bde0c2 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:05.103629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921b1c-0741-42c6-bd58-bd8ee0bde0c2 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:05.103629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921b1c-0741-42c6-bd58-bd8ee0bde0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:05.105086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 514/1007] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:05.126382 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-33921b1c-0741-42c6-bd58-bd8ee0bde0c2 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:05.127817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-33921b1c-0741-42c6-bd58-bd8ee0bde0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:05.136820 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 494/1008] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:05.186906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828639e-7bde-4c54-bf42-c916eebbfd7c None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:05.201796 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828639e-7bde-4c54-bf42-c916eebbfd7c None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:05.207475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:05.208482 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:05.209662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:05.210330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:05.220236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:05.222164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39eff1-b626-4952-965d-97e381465443 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:05.246169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 515/1009] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:07.963343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82930-22a4-49b4-8b17-91f77043b22f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:07.966785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82930-22a4-49b4-8b17-91f77043b22f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:07.966785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f82930-22a4-49b4-8b17-91f77043b22f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:07.966785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 495/1010] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:07.971655 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32150e-2c40-4e28-ac6b-e13a98be8747 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:07.972352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32150e-2c40-4e28-ac6b-e13a98be8747 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:07.972352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32150e-2c40-4e28-ac6b-e13a98be8747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:07.999453 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-6c32150e-2c40-4e28-ac6b-e13a98be8747 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:08.002002 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-6c32150e-2c40-4e28-ac6b-e13a98be8747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:08.015976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 516/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:08.063632 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f82930-22a4-49b4-8b17-91f77043b22f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:08.078904 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f82930-22a4-49b4-8b17-91f77043b22f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:08.084872 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:08.085611 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:08.085906 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:08.086189 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:08.097493 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:08.099216 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05927842-f455-45f8-8a0e-69def5ae3d6d service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:08.111164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 496/1012] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:11.917109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a474e3-b1ac-4d59-8aa8-5380d459376f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:11.917109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a474e3-b1ac-4d59-8aa8-5380d459376f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:11.917109 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a474e3-b1ac-4d59-8aa8-5380d459376f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:11.918081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 517/1013] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:11.923168 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97fdb-47d1-4b5f-ba39-e7a4506442ad None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:11.923863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97fdb-47d1-4b5f-ba39-e7a4506442ad None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:11.923863 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97fdb-47d1-4b5f-ba39-e7a4506442ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:11.943425 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-14a97fdb-47d1-4b5f-ba39-e7a4506442ad None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:11.944625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-14a97fdb-47d1-4b5f-ba39-e7a4506442ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:11.952476 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 497/1014] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:11.997923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a474e3-b1ac-4d59-8aa8-5380d459376f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:12.013151 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a474e3-b1ac-4d59-8aa8-5380d459376f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:12.018190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:12.018852 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:12.019133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:12.019408 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:12.029271 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:12.030895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454dd3-e576-49b7-99ca-d05039f9c3ba service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:12.041632 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 518/1015] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:14.030344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d91a-3a14-46fd-aaa5-eda16ab7d3d6 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.031033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d91a-3a14-46fd-aaa5-eda16ab7d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.031033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d91a-3a14-46fd-aaa5-eda16ab7d3d6 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.032272 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 498/1016] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:14.038064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2131-fc45-4ee5-b35d-b6cd999dfe28 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.038637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2131-fc45-4ee5-b35d-b6cd999dfe28 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.038637 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c2131-fc45-4ee5-b35d-b6cd999dfe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.056603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3c0c2131-fc45-4ee5-b35d-b6cd999dfe28 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:14.057832 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3c0c2131-fc45-4ee5-b35d-b6cd999dfe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:14.065555 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 519/1017] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:14.122823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3dcc1-f300-4d6b-89ae-3fb357359c3f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.123035 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3dcc1-f300-4d6b-89ae-3fb357359c3f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.123483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3dcc1-f300-4d6b-89ae-3fb357359c3f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.124913 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 499/1018] 10.222.0.44 () {54 vars in 962 bytes} [Thu May 12 16:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:14.129858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae05-fa73-4c85-a002-5736a2526247 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.130797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae05-fa73-4c85-a002-5736a2526247 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.131326 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ae05-fa73-4c85-a002-5736a2526247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.183289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2355ae05-fa73-4c85-a002-5736a2526247 None None] MFA Rules not processed for user `530a81ba35704a64a07d373ef18b4ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:14.184495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2355ae05-fa73-4c85-a002-5736a2526247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:14.244476 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 520/1019] 10.222.0.44 () {58 vars in 1059 bytes} [Thu May 12 16:51:14 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:14.252917 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3dcc1-f300-4d6b-89ae-3fb357359c3f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:14.264428 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3dcc1-f300-4d6b-89ae-3fb357359c3f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:14.267936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530a81ba35704a64a07d373ef18b4ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:14.268566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.268845 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.269120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.279272 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:14.280766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd921c31-d1f4-4a26-a11c-2e9c6476c482 service glance] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:14.290563 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 500/1020] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:14.551061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96dfb-aedf-4c00-ac1e-c34faec83700 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.552952 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96dfb-aedf-4c00-ac1e-c34faec83700 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.553183 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96dfb-aedf-4c00-ac1e-c34faec83700 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.558497 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 521/1021] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:14.560730 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9685c-2f2a-4cb3-8c37-0e5d07377b09 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.561027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9685c-2f2a-4cb3-8c37-0e5d07377b09 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.561307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9685c-2f2a-4cb3-8c37-0e5d07377b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.583512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-11a9685c-2f2a-4cb3-8c37-0e5d07377b09 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:14.584732 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-11a9685c-2f2a-4cb3-8c37-0e5d07377b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:14.592590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 501/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:14.638532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96dfb-aedf-4c00-ac1e-c34faec83700 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:14.651933 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96dfb-aedf-4c00-ac1e-c34faec83700 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:14.656908 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:14.657541 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:14.657825 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:14.658102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:14.666651 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:14.668260 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf80e7-26aa-4514-84d2-1b2861c66b3d service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:14.678744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 522/1023] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:17.265505 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9566-31b7-4280-b3a5-424f81af439f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:17.266146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9566-31b7-4280-b3a5-424f81af439f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:17.266146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9566-31b7-4280-b3a5-424f81af439f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:17.267458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 502/1024] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:17.273739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f5a-6a52-4feb-bdbb-1dd1d8d44bcd None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:17.274383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f5a-6a52-4feb-bdbb-1dd1d8d44bcd None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:17.274383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62f5a-6a52-4feb-bdbb-1dd1d8d44bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:17.293064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-40d62f5a-6a52-4feb-bdbb-1dd1d8d44bcd None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:17.294388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-40d62f5a-6a52-4feb-bdbb-1dd1d8d44bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:17.302371 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 523/1025] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:51:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:17.352715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a9566-31b7-4280-b3a5-424f81af439f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:17.367456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a9566-31b7-4280-b3a5-424f81af439f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:17.374775 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:17.375433 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:17.375713 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:17.375999 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:17.385789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:17.387413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16c348-0467-4c29-ab49-afcdcd3133de service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:17.398113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 503/1026] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:30.835181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb3b76-dcef-4f54-825a-3225b529baf5 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:30.835888 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb3b76-dcef-4f54-825a-3225b529baf5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:30.835888 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb3b76-dcef-4f54-825a-3225b529baf5 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:30.837086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 524/1027] 10.222.0.44 () {54 vars in 918 bytes} [Thu May 12 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:30.842243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011cf6-92e1-4a1d-b775-bd8f3836de7c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:30.842721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011cf6-92e1-4a1d-b775-bd8f3836de7c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:30.842832 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011cf6-92e1-4a1d-b775-bd8f3836de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:30.861439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-72011cf6-92e1-4a1d-b775-bd8f3836de7c None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:30.862687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-72011cf6-92e1-4a1d-b775-bd8f3836de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:30.871785 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 504/1028] 10.222.0.44 () {58 vars in 1015 bytes} [Thu May 12 16:51:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:30.888020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0f86-f770-413d-adfb-1826c9e9669b None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:30.888310 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0f86-f770-413d-adfb-1826c9e9669b None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:30.888592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0f86-f770-413d-adfb-1826c9e9669b None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:30.890086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 525/1029] 10.222.0.44 () {54 vars in 918 bytes} [Thu May 12 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:30.894942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12ef0-541e-4529-9bfd-2e2c845ded17 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:30.895888 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12ef0-541e-4529-9bfd-2e2c845ded17 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:30.896172 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12ef0-541e-4529-9bfd-2e2c845ded17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:30.914872 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-64e12ef0-541e-4529-9bfd-2e2c845ded17 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:30.916064 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-64e12ef0-541e-4529-9bfd-2e2c845ded17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:30.925688 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 505/1030] 10.222.0.44 () {58 vars in 1015 bytes} [Thu May 12 16:51:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:33.798582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca3f4-581a-430f-963a-e4323d976095 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:33.799256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca3f4-581a-430f-963a-e4323d976095 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:33.799256 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca3f4-581a-430f-963a-e4323d976095 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:33.800554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 526/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:51:33.807450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8754e8f-34b0-45b9-aa18-eb163a6db868 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:33.808134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8754e8f-34b0-45b9-aa18-eb163a6db868 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:33.808134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8754e8f-34b0-45b9-aa18-eb163a6db868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:33.827757 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-b8754e8f-34b0-45b9-aa18-eb163a6db868 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:33.829013 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-b8754e8f-34b0-45b9-aa18-eb163a6db868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:33.837937 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 506/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:33.889684 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca3f4-581a-430f-963a-e4323d976095 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:33.904334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca3f4-581a-430f-963a-e4323d976095 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:33.909748 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:33.910455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:33.911368 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:33.912075 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:33.921459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:33.923119 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625ed4d-3535-4157-8ed3-0a8af0d0b0e8 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:33.936504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 527/1033] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:35.022826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834613b-de0b-4deb-91da-dd439a2f20f3 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:35.023410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834613b-de0b-4deb-91da-dd439a2f20f3 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:35.023410 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834613b-de0b-4deb-91da-dd439a2f20f3 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:35.024833 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 507/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:35.029927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dcd0-16fd-4b5e-9dc6-5703b0ce6c9c None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:35.030416 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dcd0-16fd-4b5e-9dc6-5703b0ce6c9c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:35.030514 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71dcd0-16fd-4b5e-9dc6-5703b0ce6c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:35.049131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-9c71dcd0-16fd-4b5e-9dc6-5703b0ce6c9c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:35.050369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-9c71dcd0-16fd-4b5e-9dc6-5703b0ce6c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:35.059499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 528/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:35.306103 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834613b-de0b-4deb-91da-dd439a2f20f3 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:35.320142 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834613b-de0b-4deb-91da-dd439a2f20f3 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:35.325084 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:35.325697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:35.325975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:35.326273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:35.335003 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:35.336682 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80115-6f4b-415c-9a35-b57c2d0dfb94 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:35.346818 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 508/1036] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:36.329020 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d451-33ea-4b65-b083-75f6873d74be None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:36.329614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d451-33ea-4b65-b083-75f6873d74be None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:36.329614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1d451-33ea-4b65-b083-75f6873d74be None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:36.330934 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 529/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:36.336983 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f975a-3d55-4ed0-8546-92d0ca4a557b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:36.337481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f975a-3d55-4ed0-8546-92d0ca4a557b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:36.337592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f975a-3d55-4ed0-8546-92d0ca4a557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:36.356143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-172f975a-3d55-4ed0-8546-92d0ca4a557b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:36.357402 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-172f975a-3d55-4ed0-8546-92d0ca4a557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:36.365706 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 509/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:36.525252 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1d451-33ea-4b65-b083-75f6873d74be None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:36.538451 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1d451-33ea-4b65-b083-75f6873d74be None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:36.543459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:36.544070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:36.544353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:36.544631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:36.553698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:36.555336 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40794e-4727-43c7-a8f2-7ba28e76b636 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:36.564806 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 530/1039] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:37.555446 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00d551-a5d3-4a32-a2d3-973489754a3e None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:37.556027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00d551-a5d3-4a32-a2d3-973489754a3e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:37.556027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00d551-a5d3-4a32-a2d3-973489754a3e None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:37.557394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 510/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:37.562640 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192e09-17a9-428f-b96e-49aa62b6c280 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:37.563148 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192e09-17a9-428f-b96e-49aa62b6c280 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:37.563282 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38192e09-17a9-428f-b96e-49aa62b6c280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:37.581922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-38192e09-17a9-428f-b96e-49aa62b6c280 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:37.583739 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-38192e09-17a9-428f-b96e-49aa62b6c280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:37.591904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 531/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:37.748883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00d551-a5d3-4a32-a2d3-973489754a3e None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:37.763116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00d551-a5d3-4a32-a2d3-973489754a3e None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:37.768046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:37.768684 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:37.768959 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:37.769230 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:37.778946 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:37.780527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fce9b2-6490-48be-966b-f115a5437a38 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:37.790344 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 511/1042] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:38.837997 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6a1ac-1613-4c00-9b24-0d6bb91a45c8 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:38.838628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6a1ac-1613-4c00-9b24-0d6bb91a45c8 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:38.838628 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6a1ac-1613-4c00-9b24-0d6bb91a45c8 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:38.840014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 532/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:51:38.845359 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85113c-b0bf-4b85-aa5c-babb8db3d1c9 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:38.845846 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85113c-b0bf-4b85-aa5c-babb8db3d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:38.845962 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85113c-b0bf-4b85-aa5c-babb8db3d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:38.865419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-dd85113c-b0bf-4b85-aa5c-babb8db3d1c9 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:38.866724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-dd85113c-b0bf-4b85-aa5c-babb8db3d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:38.875998 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 512/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:39.033906 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6a1ac-1613-4c00-9b24-0d6bb91a45c8 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:39.053386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6a1ac-1613-4c00-9b24-0d6bb91a45c8 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:39.058793 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:39.059463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:39.059779 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:39.060051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:39.070404 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:39.072164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215ce98-40bc-422f-8edb-997bc15ab7b1 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:39.083672 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 533/1045] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:40.086510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5e97-7765-4f26-add2-b11172ee5141 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:40.087101 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5e97-7765-4f26-add2-b11172ee5141 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:40.087101 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5e97-7765-4f26-add2-b11172ee5141 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:40.088446 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 513/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:40.094345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dab6-6b20-47db-b4b8-b63e0b131a95 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:40.094901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dab6-6b20-47db-b4b8-b63e0b131a95 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:40.094901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dab6-6b20-47db-b4b8-b63e0b131a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:40.113382 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4c81dab6-6b20-47db-b4b8-b63e0b131a95 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:40.114749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4c81dab6-6b20-47db-b4b8-b63e0b131a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:40.122889 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 534/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:40.279625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5e97-7765-4f26-add2-b11172ee5141 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:40.293601 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5e97-7765-4f26-add2-b11172ee5141 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:40.298649 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:40.299291 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:40.299575 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:40.299852 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:40.308944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:40.310599 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708ffd5-8fb0-4de5-9501-414958eec3cd service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:40.320956 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 514/1048] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:41.313923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675f8b-7ccf-4ad7-92cd-b675494077bd None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:41.314597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675f8b-7ccf-4ad7-92cd-b675494077bd None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:41.314597 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675f8b-7ccf-4ad7-92cd-b675494077bd None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:41.315810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 535/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:41.321555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9657b6-f9e6-47af-b909-f8d4c7d0e8e1 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:41.322117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9657b6-f9e6-47af-b909-f8d4c7d0e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:41.322117 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9657b6-f9e6-47af-b909-f8d4c7d0e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:41.341267 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-bf9657b6-f9e6-47af-b909-f8d4c7d0e8e1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:41.342512 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-bf9657b6-f9e6-47af-b909-f8d4c7d0e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:41.351075 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 515/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:41.511117 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675f8b-7ccf-4ad7-92cd-b675494077bd None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:41.525241 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675f8b-7ccf-4ad7-92cd-b675494077bd None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:41.530795 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:41.531452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:41.531730 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:41.531998 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:41.541746 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:41.543407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7324-a31d-4c4d-9ec3-47fe05b63afd service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:41.554033 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 536/1051] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:42.498102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbc2-6914-45a0-8787-e428a40f0ef2 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:42.498787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbc2-6914-45a0-8787-e428a40f0ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:42.498787 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefbc2-6914-45a0-8787-e428a40f0ef2 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:42.500036 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 516/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:42.506218 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12223-31dc-46be-bc96-b179aa242667 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:42.506710 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12223-31dc-46be-bc96-b179aa242667 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:42.506816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d12223-31dc-46be-bc96-b179aa242667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:42.526365 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-60d12223-31dc-46be-bc96-b179aa242667 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:42.527578 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-60d12223-31dc-46be-bc96-b179aa242667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:42.535573 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 537/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:42.695768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefbc2-6914-45a0-8787-e428a40f0ef2 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:42.709808 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefbc2-6914-45a0-8787-e428a40f0ef2 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:42.714763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:42.715431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:42.715711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:42.715985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:42.724756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:42.726374 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fc86-f90f-4a81-84b5-8a41dca5c8a6 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:42.735803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 517/1054] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:43.728598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6e81-5538-4cf0-9b36-321ed2bb06ed None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:43.729992 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6e81-5538-4cf0-9b36-321ed2bb06ed None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:43.729992 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6e81-5538-4cf0-9b36-321ed2bb06ed None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:43.730553 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 538/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:43.736437 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c67c-dee1-4f08-8d2e-c5193ce7508e None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:43.737149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c67c-dee1-4f08-8d2e-c5193ce7508e None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:43.737149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c67c-dee1-4f08-8d2e-c5193ce7508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:43.755510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-1a54c67c-dee1-4f08-8d2e-c5193ce7508e None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:43.756708 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-1a54c67c-dee1-4f08-8d2e-c5193ce7508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:43.764996 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 518/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:51:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:43.930751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6e81-5538-4cf0-9b36-321ed2bb06ed None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:43.944631 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6e81-5538-4cf0-9b36-321ed2bb06ed None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:43.949639 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:43.950316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:43.950598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:43.950875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:43.959601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:43.961186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43716178-4f2b-4ac3-a10b-c1d86dddaf52 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:43.970639 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 539/1057] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:46.252436 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbc2f-2183-4e6a-83a5-e96430e228e4 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:46.253026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbc2f-2183-4e6a-83a5-e96430e228e4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:46.253026 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbc2f-2183-4e6a-83a5-e96430e228e4 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:46.255081 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 519/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:46.261346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761c94-833c-4c30-8c1d-6f99cfc0b461 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:46.261900 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761c94-833c-4c30-8c1d-6f99cfc0b461 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:46.261900 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761c94-833c-4c30-8c1d-6f99cfc0b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:46.280193 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-44761c94-833c-4c30-8c1d-6f99cfc0b461 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:46.281407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-44761c94-833c-4c30-8c1d-6f99cfc0b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:46.289431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 540/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:46.337865 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbc2f-2183-4e6a-83a5-e96430e228e4 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:46.349900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbc2f-2183-4e6a-83a5-e96430e228e4 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:46.353485 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:46.354124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:46.354434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:46.354735 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:46.364817 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:46.366294 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f107b1-797b-4c9a-ba47-19c403c27e2e service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:46.376603 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 520/1060] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:48.913603 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104cf9-683b-4e5e-a5e6-c8ca33e66176 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:48.914139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104cf9-683b-4e5e-a5e6-c8ca33e66176 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:48.914139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104cf9-683b-4e5e-a5e6-c8ca33e66176 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:48.915594 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 541/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:48.921442 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b026-a620-4b30-aef7-813500c81029 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:48.923968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b026-a620-4b30-aef7-813500c81029 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:48.923968 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b026-a620-4b30-aef7-813500c81029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:48.940605 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-88a7b026-a620-4b30-aef7-813500c81029 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:48.941857 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-88a7b026-a620-4b30-aef7-813500c81029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:48.950151 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 521/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:48.989478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104cf9-683b-4e5e-a5e6-c8ca33e66176 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:49.000207 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104cf9-683b-4e5e-a5e6-c8ca33e66176 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:49.004019 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:49.004674 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:49.004953 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:49.005228 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:49.014944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:49.016386 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e73cb4-4552-4147-88ab-9c57758ba253 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:49.026367 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 542/1063] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:51.890924 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf466-9665-4428-9884-367f43abc0c3 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:51.891491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf466-9665-4428-9884-367f43abc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:51.891491 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf466-9665-4428-9884-367f43abc0c3 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:51.892837 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 522/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:51.899317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875f606-3a91-4fd5-908c-f9a7b69e8518 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:51.899804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875f606-3a91-4fd5-908c-f9a7b69e8518 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:51.900003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875f606-3a91-4fd5-908c-f9a7b69e8518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:51.918007 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-c875f606-3a91-4fd5-908c-f9a7b69e8518 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:51.922650 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c875f606-3a91-4fd5-908c-f9a7b69e8518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:51.927440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 543/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:51.968306 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccf466-9665-4428-9884-367f43abc0c3 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:51.979273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccf466-9665-4428-9884-367f43abc0c3 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:51.982932 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:51.983597 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:51.983879 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:51.984155 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:51.993699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:51.995169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9e80e-247c-41e6-b176-898995028c39 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:52.005286 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 523/1066] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:54.640330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2e5f-88b1-4a88-ab2f-7f80ce8a3865 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:54.641077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2e5f-88b1-4a88-ab2f-7f80ce8a3865 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:54.641077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2e5f-88b1-4a88-ab2f-7f80ce8a3865 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:54.642654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 544/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:54.648984 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad272a-5797-4c8a-b296-fb7592893487 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:54.649541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad272a-5797-4c8a-b296-fb7592893487 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:54.649541 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad272a-5797-4c8a-b296-fb7592893487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:54.668228 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-9fad272a-5797-4c8a-b296-fb7592893487 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:54.669458 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-9fad272a-5797-4c8a-b296-fb7592893487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:54.677936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 524/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:54.720594 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba2e5f-88b1-4a88-ab2f-7f80ce8a3865 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:54.733874 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba2e5f-88b1-4a88-ab2f-7f80ce8a3865 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:54.737570 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:54.738673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:54.738673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:54.739040 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:54.749449 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:54.751380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a586-0176-4c84-b848-b398630e53b7 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:54.763422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 545/1069] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:57.267974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a545-4146-49e1-8f0e-e9724ba46165 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:57.268524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a545-4146-49e1-8f0e-e9724ba46165 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:57.268524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832a545-4146-49e1-8f0e-e9724ba46165 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:57.270180 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 525/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:57.277398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87880-c1de-4e9d-88b0-8f9fbac232b0 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:57.277969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87880-c1de-4e9d-88b0-8f9fbac232b0 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:57.277969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87880-c1de-4e9d-88b0-8f9fbac232b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:57.296582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-e1e87880-c1de-4e9d-88b0-8f9fbac232b0 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:57.297818 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-e1e87880-c1de-4e9d-88b0-8f9fbac232b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:57.307099 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 546/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:57.346900 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a545-4146-49e1-8f0e-e9724ba46165 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:57.358951 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832a545-4146-49e1-8f0e-e9724ba46165 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:57.362694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:57.364305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:57.364794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:57.365297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:57.378118 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:57.380403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1218ef-a916-4f4c-90fd-60ce79617ee8 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:57.392630 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 526/1072] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:51:59.842840 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2aa96-f752-4714-a216-509c1705a0cd None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:59.843397 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2aa96-f752-4714-a216-509c1705a0cd None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:59.843494 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2aa96-f752-4714-a216-509c1705a0cd None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:59.844858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 547/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:51:59.851232 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43ef3-8be4-4e92-bf7f-b69599ca7164 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:59.851789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43ef3-8be4-4e92-bf7f-b69599ca7164 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:59.851789 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43ef3-8be4-4e92-bf7f-b69599ca7164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:59.869773 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-fcd43ef3-8be4-4e92-bf7f-b69599ca7164 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:51:59.871017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-fcd43ef3-8be4-4e92-bf7f-b69599ca7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:51:59.879490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 527/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:51:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:51:59.919999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2aa96-f752-4714-a216-509c1705a0cd None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:51:59.933532 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2aa96-f752-4714-a216-509c1705a0cd None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:51:59.938332 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:51:59.939204 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:59.939491 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:59.939768 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:59.952334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:51:59.953881 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f672e0-ed80-413c-b6c9-2199a69fb5e7 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:51:59.965055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 548/1075] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:51:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:52:02.357439 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c922-ae8a-4f42-8c70-f956bae80f67 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:02.358090 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c922-ae8a-4f42-8c70-f956bae80f67 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:02.358090 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c922-ae8a-4f42-8c70-f956bae80f67 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:02.359329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 528/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:02.364787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5094f6-c34d-400e-ae1f-3e3ea5f5068d None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:02.365270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5094f6-c34d-400e-ae1f-3e3ea5f5068d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:02.365376 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5094f6-c34d-400e-ae1f-3e3ea5f5068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:02.383984 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2b5094f6-c34d-400e-ae1f-3e3ea5f5068d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:02.385190 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2b5094f6-c34d-400e-ae1f-3e3ea5f5068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:02.393051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 549/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:52:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:02.432235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80c922-ae8a-4f42-8c70-f956bae80f67 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:02.443498 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80c922-ae8a-4f42-8c70-f956bae80f67 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:02.447017 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:02.447663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:02.447947 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:02.448224 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:02.458530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:02.460008 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d150c0-c949-48f0-96f4-b8043504757f service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:02.470109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 529/1078] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:04.834474 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db95c-ce6f-4cd5-a7cc-3938b0bdd702 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:04.835052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db95c-ce6f-4cd5-a7cc-3938b0bdd702 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:04.835052 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db95c-ce6f-4cd5-a7cc-3938b0bdd702 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:04.836388 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 550/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:04.841953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa03b-8f6d-4577-a4c1-629a9dd5fef0 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:04.842520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa03b-8f6d-4577-a4c1-629a9dd5fef0 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:04.842520 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa03b-8f6d-4577-a4c1-629a9dd5fef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:04.860092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ffdfa03b-8f6d-4577-a4c1-629a9dd5fef0 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:04.861296 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ffdfa03b-8f6d-4577-a4c1-629a9dd5fef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:04.869923 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 530/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:52:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:52:04.909737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db95c-ce6f-4cd5-a7cc-3938b0bdd702 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:04.920313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db95c-ce6f-4cd5-a7cc-3938b0bdd702 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:04.923890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:04.924530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:04.924807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:04.925086 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:04.934582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:04.936016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80fa73-c45c-4e8c-8779-44c2f4a8cae6 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:04.946520 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 551/1081] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:07.386352 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b732cf-31f3-4240-88de-d3cd09a90e20 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:07.386881 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b732cf-31f3-4240-88de-d3cd09a90e20 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:07.386881 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b732cf-31f3-4240-88de-d3cd09a90e20 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:07.388248 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 531/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:07.394504 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522c1b-9bd6-4353-8d3e-804d02fb4d47 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:07.395089 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522c1b-9bd6-4353-8d3e-804d02fb4d47 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:07.395089 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5522c1b-9bd6-4353-8d3e-804d02fb4d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:07.412917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-f5522c1b-9bd6-4353-8d3e-804d02fb4d47 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:07.414110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-f5522c1b-9bd6-4353-8d3e-804d02fb4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:07.422003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 552/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:52:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:07.460056 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b732cf-31f3-4240-88de-d3cd09a90e20 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:07.470995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b732cf-31f3-4240-88de-d3cd09a90e20 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:07.475295 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:07.475982 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:07.476265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:07.476528 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:07.486783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:07.488567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189967d5-addf-4804-93f3-7f2d87ecd7fc service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:07.498856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 532/1084] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:09.874608 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657925-fff2-43e8-b8e2-33bd6c8ccb79 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:09.875102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657925-fff2-43e8-b8e2-33bd6c8ccb79 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:09.875215 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657925-fff2-43e8-b8e2-33bd6c8ccb79 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:09.876600 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 553/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:09.883974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b41f8-826d-4d45-ba67-50b58d8dbe53 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:09.884535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b41f8-826d-4d45-ba67-50b58d8dbe53 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:09.884655 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b41f8-826d-4d45-ba67-50b58d8dbe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:09.902980 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-274b41f8-826d-4d45-ba67-50b58d8dbe53 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:09.904263 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-274b41f8-826d-4d45-ba67-50b58d8dbe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:09.913096 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 533/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:52:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:09.951422 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657925-fff2-43e8-b8e2-33bd6c8ccb79 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:09.964648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657925-fff2-43e8-b8e2-33bd6c8ccb79 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:09.968264 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:09.968902 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:09.969186 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:09.969495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:09.979923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:09.981467 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b5e83-efb7-4013-a5a3-f8887ee9fc5f service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:09.993917 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 554/1087] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:45.260582 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987fa9-6482-4c55-9840-8adf43740cd4 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.261184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987fa9-6482-4c55-9840-8adf43740cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.261184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987fa9-6482-4c55-9840-8adf43740cd4 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.262524 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 534/1088] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.270334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df98b-6374-4f73-a6b8-c1a820059b20 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.270891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df98b-6374-4f73-a6b8-c1a820059b20 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.270994 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2df98b-6374-4f73-a6b8-c1a820059b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.291217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2a2df98b-6374-4f73-a6b8-c1a820059b20 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.292645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2a2df98b-6374-4f73-a6b8-c1a820059b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.301069 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 555/1089] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:52:45.357090 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b35e-fe17-4158-ba25-6a2f7ca4b06d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.357377 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b35e-fe17-4158-ba25-6a2f7ca4b06d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.357718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b35e-fe17-4158-ba25-6a2f7ca4b06d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.359575 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 535/1090] 10.222.0.44 () {54 vars in 962 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.366582 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7593-405b-44ea-9aaf-2891ba246a6a None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.367058 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7593-405b-44ea-9aaf-2891ba246a6a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.367355 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7593-405b-44ea-9aaf-2891ba246a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.388491 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-03fa7593-405b-44ea-9aaf-2891ba246a6a None None] MFA Rules not processed for user `530a81ba35704a64a07d373ef18b4ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.389616 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-03fa7593-405b-44ea-9aaf-2891ba246a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.397745 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 556/1091] 10.222.0.44 () {58 vars in 1059 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:45.405790 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b35e-fe17-4158-ba25-6a2f7ca4b06d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.417509 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b35e-fe17-4158-ba25-6a2f7ca4b06d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.421299 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530a81ba35704a64a07d373ef18b4ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.436504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.436504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.436504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.436504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.436504 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17fe82-b44a-41b5-b38d-ff27343f6c9c service glance] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.445763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 536/1092] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:48.036800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df9ef-c848-4fb7-9667-d887b45d00dc None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.036800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df9ef-c848-4fb7-9667-d887b45d00dc None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.036800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df9ef-c848-4fb7-9667-d887b45d00dc None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.036800 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 557/1093] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2507b-0b8d-4abe-9720-567301b90a2c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2507b-0b8d-4abe-9720-567301b90a2c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2507b-0b8d-4abe-9720-567301b90a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-43e2507b-0b8d-4abe-9720-567301b90a2c None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-43e2507b-0b8d-4abe-9720-567301b90a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:48.037614 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 537/1094] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:52:48.038436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df9ef-c848-4fb7-9667-d887b45d00dc None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:48.038436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df9ef-c848-4fb7-9667-d887b45d00dc None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:48.038436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:48.038436 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:52:48.038747 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd6a73-31a7-4912-ae6d-693e6ce943e3 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:48.039267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 558/1095] 10.222.0.44 () {56 vars in 1108 bytes} [Thu May 12 16:52:47 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:52:50.324938 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1768-7d5b-4d7d-9dce-ba5d7f5cbc7d None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.325456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1768-7d5b-4d7d-9dce-ba5d7f5cbc7d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.325456 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1768-7d5b-4d7d-9dce-ba5d7f5cbc7d None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.326862 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 538/1096] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:50.332614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c7a4-eccf-4e2e-8cb4-1ef27d085fad None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.333044 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c7a4-eccf-4e2e-8cb4-1ef27d085fad None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.333168 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582c7a4-eccf-4e2e-8cb4-1ef27d085fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.352016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4582c7a4-eccf-4e2e-8cb4-1ef27d085fad None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:50.353237 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4582c7a4-eccf-4e2e-8cb4-1ef27d085fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:50.361732 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 559/1097] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:50.411581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1768-7d5b-4d7d-9dce-ba5d7f5cbc7d None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.425531 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1768-7d5b-4d7d-9dce-ba5d7f5cbc7d None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.430555 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.431192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.431478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.431762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.440162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:50.441750 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6bac6-02ed-444d-a371-008a81bbb98a service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:50.451326 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 539/1098] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:52.890700 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fee3-33a2-4d1b-8441-1cfd41d6db28 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.891208 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fee3-33a2-4d1b-8441-1cfd41d6db28 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.891320 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fee3-33a2-4d1b-8441-1cfd41d6db28 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.892781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 560/1099] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:52.897955 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd120-d0ce-4851-acad-084d5a68991a None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.898536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd120-d0ce-4851-acad-084d5a68991a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.898536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd120-d0ce-4851-acad-084d5a68991a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.917091 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-6dedd120-d0ce-4851-acad-084d5a68991a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:52.918330 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-6dedd120-d0ce-4851-acad-084d5a68991a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:52.927052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 540/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:52.963177 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fee3-33a2-4d1b-8441-1cfd41d6db28 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:52.974270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fee3-33a2-4d1b-8441-1cfd41d6db28 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:52.977845 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:52.978522 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.978807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.979083 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.988944 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:52.990415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaeefa-bd30-4d2f-81cb-d9376a394dca service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:52.999958 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 561/1101] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:55.354445 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a81c-863d-41ca-b711-067e714c5c96 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.355018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a81c-863d-41ca-b711-067e714c5c96 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.355018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a81c-863d-41ca-b711-067e714c5c96 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.356335 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 541/1102] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:55.361694 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c794d9-8530-4b3b-ad1c-573afe6df315 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.362170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c794d9-8530-4b3b-ad1c-573afe6df315 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.362373 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c794d9-8530-4b3b-ad1c-573afe6df315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.379788 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-b2c794d9-8530-4b3b-ad1c-573afe6df315 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:55.381054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-b2c794d9-8530-4b3b-ad1c-573afe6df315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:55.389619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 562/1103] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:55.435629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a81c-863d-41ca-b711-067e714c5c96 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:55.447417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a81c-863d-41ca-b711-067e714c5c96 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:55.450993 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:55.451633 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.451909 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.452184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.461743 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:55.463200 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eb49c-55c6-457b-ac8c-c7f3369f239f service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:55.473144 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 542/1104] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:52:57.903029 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade754-0cc0-4968-983b-b2bb66bc5224 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.903556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade754-0cc0-4968-983b-b2bb66bc5224 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.903556 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade754-0cc0-4968-983b-b2bb66bc5224 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.904922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 563/1105] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:57.910328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31c88-a5b5-4e22-8e52-ed3fcaa67406 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.910776 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31c88-a5b5-4e22-8e52-ed3fcaa67406 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.910873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31c88-a5b5-4e22-8e52-ed3fcaa67406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.928312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-05b31c88-a5b5-4e22-8e52-ed3fcaa67406 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:57.929523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-05b31c88-a5b5-4e22-8e52-ed3fcaa67406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:57.937290 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 543/1106] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:52:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:52:57.978761 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade754-0cc0-4968-983b-b2bb66bc5224 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.989369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade754-0cc0-4968-983b-b2bb66bc5224 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.993271 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.993912 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.994207 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.994521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.005046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.006512 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd972-2141-412d-92bf-7367bf5eb0a5 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.016394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 564/1107] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:53:00.870484 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fa5c-c25c-45f4-b798-ced6fe7a0797 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.871023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fa5c-c25c-45f4-b798-ced6fe7a0797 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.871023 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638fa5c-c25c-45f4-b798-ced6fe7a0797 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.872400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 544/1108] 10.222.0.44 () {54 vars in 926 bytes} [Thu May 12 16:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:00.877877 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b571e-aa85-4392-aa91-6749e512b021 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.878346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b571e-aa85-4392-aa91-6749e512b021 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.878440 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b571e-aa85-4392-aa91-6749e512b021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.901894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3f7b571e-aa85-4392-aa91-6749e512b021 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:00.903343 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3f7b571e-aa85-4392-aa91-6749e512b021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:00.912410 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 565/1109] 10.222.0.44 () {58 vars in 1023 bytes} [Thu May 12 16:53:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:53:00.953214 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fa5c-c25c-45f4-b798-ced6fe7a0797 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.964813 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638fa5c-c25c-45f4-b798-ced6fe7a0797 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.968483 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.969106 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.969380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.969650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.981495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.982953 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4361d-ad03-4d64-986d-e2424467fc15 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.993500 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 545/1110] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:54:42.555415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:42.556102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:42.556102 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:42.579170 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:42.580966 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:42.588891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 566/1111] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:54:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:54:42.598838 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:42.599397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:42.599397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:42.618296 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:42.619560 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:42.627975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 546/1112] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:54:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:54:42.632753 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:42.644185 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79192bb3-74de-4ad0-8e4d-a3f38d3a591a None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:42.648987 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:42.649657 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:42.649939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:42.650248 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:42.650977 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:42.651277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:42.652288 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:42.652288 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:54:42.652288 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:54:42.653200 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:42.666415 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 567/1113] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 12 16:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:42.675578 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:42.685440 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f50cc-51c3-4134-a24b-0fc9ecbd2137 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:42.690729 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:42.691471 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:42.691800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:42.692120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:42.692936 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:42.694948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:42.694948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:54:42.694948 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:54:42.696309 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:42.853755 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 547/1114] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 12 16:54:42 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:54:42.858622 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:42.868892 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7a96-09bc-4ce0-bef1-100a21ceaf8d admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:42.927698 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:42.928368 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:42.928651 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:42.928922 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:42.929619 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:42.930673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:42.930673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:54:42.930673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:54:42.931880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.041204 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 568/1115] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 12 16:54:42 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:54:43.045421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:43.056213 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19dabc-3f00-4877-b2e6-771fe321b430 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:43.061905 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:43.062974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.063256 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.063532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.064254 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:43.065265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:43.065265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:54:43.065265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:54:43.066146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.079722 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 548/1116] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:54:43.083852 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:43.094820 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a610a-48a3-4099-bd54-2b5a57ca7e9b admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:43.099567 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:43.100229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.100523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.100787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.101505 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:43.102634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:43.102634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:54:43.102634 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:54:43.103550 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13342da2-219e-4382-bdb4-6013bcc3d9ee admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.118477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 569/1117] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:54:43.122678 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:43.133010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ad97-fe18-458d-98af-031f6868ef26 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:43.138065 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:43.139127 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.139414 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.139692 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] PATH_INFO: `/v3/projects/be2eb6fd24074f52834c80487a8c35ac/users/7294335ca7f6453786cc73c10e302244/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.155814 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2eb6fd24074f52834c80487a8c35ac, user_id=7294335ca7f6453786cc73c10e302244, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:43.156868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:43.156868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:54:43.156868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:54:43.158928 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811d58-64d0-4be7-9fd7-cf594ae17408 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.243336 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 549/1118] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:54:43 2022] PUT /identity/v3/projects/be2eb6fd24074f52834c80487a8c35ac/users/7294335ca7f6453786cc73c10e302244/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:54:43.255164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9643f3-9db3-4faf-b68e-caf913df69e1 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.255655 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9643f3-9db3-4faf-b68e-caf913df69e1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.256431 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9643f3-9db3-4faf-b68e-caf913df69e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.284251 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3d9643f3-9db3-4faf-b68e-caf913df69e1 None None] MFA Rules not processed for user `7294335ca7f6453786cc73c10e302244`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:43.285491 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3d9643f3-9db3-4faf-b68e-caf913df69e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:43.354298 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 570/1119] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:54:43 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:54:43.367657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c542d-2359-46dd-9999-5585f8e2749f None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.367944 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c542d-2359-46dd-9999-5585f8e2749f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.368218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c542d-2359-46dd-9999-5585f8e2749f None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.369642 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 550/1120] 10.222.0.44 () {54 vars in 963 bytes} [Thu May 12 16:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:43.375037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfbbb8-5d70-4ddd-bd8d-dc166618b0d3 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.382255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfbbb8-5d70-4ddd-bd8d-dc166618b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.382255 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfbbb8-5d70-4ddd-bd8d-dc166618b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.394240 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-dfdfbbb8-5d70-4ddd-bd8d-dc166618b0d3 None None] MFA Rules not processed for user `c91e736aa84b449bb0657de099a88ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:43.395439 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-dfdfbbb8-5d70-4ddd-bd8d-dc166618b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:43.445695 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 571/1121] 10.222.0.44 () {58 vars in 1060 bytes} [Thu May 12 16:54:43 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:54:43.453703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c542d-2359-46dd-9999-5585f8e2749f None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:43.464381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c542d-2359-46dd-9999-5585f8e2749f None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:43.468639 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91e736aa84b449bb0657de099a88ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:43.469328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.469612 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.469895 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.478532 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:43.479985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.489009 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 551/1122] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:54:43 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:54:43.530523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fcf4-4e7e-4810-8717-ab50b5bb52b9 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.530829 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fcf4-4e7e-4810-8717-ab50b5bb52b9 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.531131 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66fcf4-4e7e-4810-8717-ab50b5bb52b9 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.532453 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 572/1123] 10.222.0.44 () {52 vars in 829 bytes} [Thu May 12 16:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:43.536027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:43.618341 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027085c-9c1a-49a7-a54b-5a1de2c8aed2 service cinder] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:43.623235 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:43.624825 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:43.625111 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:43.625395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] PATH_INFO: `/v3/users/7294335ca7f6453786cc73c10e302244` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:43.626667 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7294335ca7f6453786cc73c10e302244)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:43.627696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:43.627696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:54:43.627696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:54:43.628949 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:43.888154 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7294335ca7f6453786cc73c10e302244'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:43.888490 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7294335ca7f6453786cc73c10e302244'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:43.904361 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7294335ca7f6453786cc73c10e302244'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:43.905744 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7294335ca7f6453786cc73c10e302244'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:43.929133 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7294335ca7f6453786cc73c10e302244'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:44.008762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 552/1124] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 12 16:54:43 2022] DELETE /identity/v3/users/7294335ca7f6453786cc73c10e302244 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:54:44.013671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:44.014707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:44.014707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:44.032098 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:44.033304 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:44.098939 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 573/1125] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:54:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:54:44.110564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:44.112027 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:44.176105 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ed442-53bd-4b83-8810-ddb7907a02b8 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:44.179762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:44.180416 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:44.180697 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:44.180971 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:44.191696 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:44.193229 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed3b4-55d4-4244-bf16-c0b2adc53654 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:44.203495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 553/1126] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:54:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:54:44.730477 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:44.731973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:44.745468 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d918bca-cfc6-43fd-9dbe-c9b571350a94 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:44.749518 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:44.750920 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:44.751499 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:44.751762 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] PATH_INFO: `/v3/projects/be2eb6fd24074f52834c80487a8c35ac` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:44.753003 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2eb6fd24074f52834c80487a8c35ac)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:44.754290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:54:44.754290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:54:44.754290 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:54:44.755393 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:44.919434 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2eb6fd24074f52834c80487a8c35ac', 'request_id': 'req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:44.927751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2eb6fd24074f52834c80487a8c35ac', 'request_id': 'req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:45.014037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2eb6fd24074f52834c80487a8c35ac', 'request_id': 'req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:45.034455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] The token cache is being invalidate because project be2eb6fd24074f52834c80487a8c35ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 16:54:45.034744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:45.035400 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-d8bb3740-65a9-4f6f-9cc1-337ba1fffb72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 16:54:45.037068 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 574/1127] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 12 16:54:44 2022] DELETE /identity/v3/projects/be2eb6fd24074f52834c80487a8c35ac => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:56:09.889675 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:09.890191 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:09.890324 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:09.891646 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 554/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:56:09.896521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c848-fe39-4393-b0e3-d9483c2255e3 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:09.896965 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c848-fe39-4393-b0e3-d9483c2255e3 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:09.897081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c848-fe39-4393-b0e3-d9483c2255e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:09.914937 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ef46c848-fe39-4393-b0e3-d9483c2255e3 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:09.916145 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ef46c848-fe39-4393-b0e3-d9483c2255e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:09.972887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 575/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:56:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:10.154771 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:10.156421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:10.225130 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bf0cb-dba8-4010-bc81-84b4b3c1ac7c None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:10.230102 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:10.230975 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:10.231260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:10.231535 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:10.239897 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:10.241481 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3b80-4197-4075-a44f-cdd835d9407a service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:10.251340 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 555/1130] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:11.157070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7e3b9-bdbe-4d65-b272-ae21c4641c78 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:11.157589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7e3b9-bdbe-4d65-b272-ae21c4641c78 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:11.157589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7e3b9-bdbe-4d65-b272-ae21c4641c78 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:11.159072 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 576/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:56:11.163805 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cac0-0a73-44e5-8e49-034ee3f8e2f8 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:11.164281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cac0-0a73-44e5-8e49-034ee3f8e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:11.164392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425cac0-0a73-44e5-8e49-034ee3f8e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:11.182415 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-8425cac0-0a73-44e5-8e49-034ee3f8e2f8 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:11.183943 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-8425cac0-0a73-44e5-8e49-034ee3f8e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:11.191732 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 556/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:56:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:56:11.346070 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7e3b9-bdbe-4d65-b272-ae21c4641c78 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:11.359777 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7e3b9-bdbe-4d65-b272-ae21c4641c78 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:11.365028 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:11.365671 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:11.366061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:11.366369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:11.375469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:11.377077 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527dc5d-7161-4182-a8c1-2c9cbf26709f service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:11.387607 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 577/1133] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:15.125880 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e7e6-4667-4cb2-bb75-92bf12ace052 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:15.126473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e7e6-4667-4cb2-bb75-92bf12ace052 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:15.126473 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e7e6-4667-4cb2-bb75-92bf12ace052 None None] PATH_INFO: `/v3` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:15.127763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 557/1134] 10.222.0.25 () {54 vars in 925 bytes} [Thu May 12 16:56:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:56:15.133478 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e2d0-8b04-4ee7-aea7-028ae66f0b3c None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:15.133930 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e2d0-8b04-4ee7-aea7-028ae66f0b3c None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:15.134037 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e2d0-8b04-4ee7-aea7-028ae66f0b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:15.163331 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ee12e2d0-8b04-4ee7-aea7-028ae66f0b3c None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:15.164521 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ee12e2d0-8b04-4ee7-aea7-028ae66f0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:15.224047 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 578/1135] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 12 16:56:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:22.728810 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91b3c-958f-42a8-8be4-72ec0e221561 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:22.729438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91b3c-958f-42a8-8be4-72ec0e221561 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:22.729438 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91b3c-958f-42a8-8be4-72ec0e221561 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:22.731400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:22.736296 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7689-ef53-4c47-916b-9db3b82cd4a1 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:22.736709 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7689-ef53-4c47-916b-9db3b82cd4a1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:22.736843 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7689-ef53-4c47-916b-9db3b82cd4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:22.756886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-5c5f7689-ef53-4c47-916b-9db3b82cd4a1 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:22.758072 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-5c5f7689-ef53-4c47-916b-9db3b82cd4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:22.766178 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:56:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:22.923355 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91b3c-958f-42a8-8be4-72ec0e221561 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:22.938124 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91b3c-958f-42a8-8be4-72ec0e221561 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:22.943125 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:22.947759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:22.947759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:22.947759 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:22.952650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:22.954255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a21a4-ffe3-4451-a8da-7eee5ef169f0 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:22.963800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 559/1138] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:23.882276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9de0e-bff3-4f36-80cd-2645cd8b6e7f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:23.882780 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9de0e-bff3-4f36-80cd-2645cd8b6e7f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:23.882886 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9de0e-bff3-4f36-80cd-2645cd8b6e7f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:23.884232 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:23.890393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578ff8-3fe1-4ef2-b823-a33b0e991734 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:23.890875 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578ff8-3fe1-4ef2-b823-a33b0e991734 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:23.890988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578ff8-3fe1-4ef2-b823-a33b0e991734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:23.909255 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0c578ff8-3fe1-4ef2-b823-a33b0e991734 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:23.910479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0c578ff8-3fe1-4ef2-b823-a33b0e991734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:23.919441 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:56:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:24.073473 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9de0e-bff3-4f36-80cd-2645cd8b6e7f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:24.087105 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9de0e-bff3-4f36-80cd-2645cd8b6e7f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:24.092708 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:24.093348 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:24.093629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:24.093901 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:24.102590 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:24.104585 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d350e-366f-40d9-a9fe-9e02d4686d89 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:24.116662 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 581/1141] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:24.354730 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dde0-c132-4ade-b9fa-78fbd271c460 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:24.355010 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dde0-c132-4ade-b9fa-78fbd271c460 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:24.355283 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9dde0-c132-4ade-b9fa-78fbd271c460 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:24.357167 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 561/1142] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 12 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:24.362302 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840afe-58fc-45b4-aaac-8fc637dd2488 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:24.362598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840afe-58fc-45b4-aaac-8fc637dd2488 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:24.362878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840afe-58fc-45b4-aaac-8fc637dd2488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:24.381451 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-10840afe-58fc-45b4-aaac-8fc637dd2488 None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:24.382614 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-10840afe-58fc-45b4-aaac-8fc637dd2488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:24.391432 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 582/1143] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 12 16:56:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:24.398694 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9dde0-c132-4ade-b9fa-78fbd271c460 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:24.411856 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9dde0-c132-4ade-b9fa-78fbd271c460 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:24.416854 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12fdfcd0ace142d49be44ff2772425f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:24.417474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:24.417753 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:24.418657 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:24.427215 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:24.428797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b7da-9f88-4126-b0ae-c3ee05cd2585 service placement] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:24.439188 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 562/1144] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:28.668064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:28.668667 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:28.668667 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:28.670566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:28.676100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d7e0-a63a-4655-85bb-10a161115d3d None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:28.676594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d7e0-a63a-4655-85bb-10a161115d3d None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:28.676797 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d7e0-a63a-4655-85bb-10a161115d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:28.695536 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-e4c0d7e0-a63a-4655-85bb-10a161115d3d None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:28.696777 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-e4c0d7e0-a63a-4655-85bb-10a161115d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:28.704992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:56:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:28.743088 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:28.744797 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:28.808448 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467066-5f40-4f74-89b8-dfe3a7594287 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:28.813606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:28.813606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:28.813606 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:28.814046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:28.823592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:28.825039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7667a2-4466-45f3-8aee-89dd74f96387 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:28.835312 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 584/1147] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:31.165992 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:31.166564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:31.166564 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:31.167885 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 564/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:31.173444 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f47a-1ab4-4a28-a780-4e04a8111997 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:31.173911 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f47a-1ab4-4a28-a780-4e04a8111997 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:31.174018 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f47a-1ab4-4a28-a780-4e04a8111997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:31.192169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-2968f47a-1ab4-4a28-a780-4e04a8111997 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:31.193380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-2968f47a-1ab4-4a28-a780-4e04a8111997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:31.202589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 585/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:56:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:31.239782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:31.241451 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:31.254970 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f73db-707a-4286-87fc-7078fbbc5087 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:31.258702 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:31.259345 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:31.259631 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:31.259911 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:31.270251 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:31.271687 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554499b2-4861-4a3d-8898-f0b84b699606 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:31.281056 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 565/1150] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:35.382345 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:35.382875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:35.382875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:35.384235 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 586/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:35.390778 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9ca-5811-45ff-b047-00105e53a926 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:35.391227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9ca-5811-45ff-b047-00105e53a926 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:35.391328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b9ca-5811-45ff-b047-00105e53a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:35.409891 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-cc73b9ca-5811-45ff-b047-00105e53a926 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:35.412176 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-cc73b9ca-5811-45ff-b047-00105e53a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:35.419109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 566/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:56:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:35.702220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:35.703925 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:35.760869 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2125b4f-7dc2-45b5-9ce0-6c292c510da1 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:35.765891 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91e736aa84b449bb0657de099a88ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:35.766569 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:35.766851 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:35.767127 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:35.776323 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:35.777749 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db52c52-d5f4-4670-a6da-6bb2ee0a376c service cinder] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:35.787611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 587/1153] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:38.166877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:38.167418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:38.167418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:38.168756 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 567/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:38.173919 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5839da-89a0-44ef-aea6-2a551294cd68 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:38.174358 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5839da-89a0-44ef-aea6-2a551294cd68 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:38.174509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5839da-89a0-44ef-aea6-2a551294cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:38.192542 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4e5839da-89a0-44ef-aea6-2a551294cd68 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:38.193734 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4e5839da-89a0-44ef-aea6-2a551294cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:38.202146 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 588/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:56:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:38.480202 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:38.481878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:38.495279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734337f-ca3c-49a7-be77-83f83135484a None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:38.499435 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91e736aa84b449bb0657de099a88ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:38.500072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:38.500352 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:38.500680 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:38.509584 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:38.511051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22ed2-d543-485a-813c-afe62e732ec4 service cinder] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:38.520833 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 568/1156] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:56:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:00.756316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a4c-3ab9-450a-ae0a-edc7502301de None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.757062 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a4c-3ab9-450a-ae0a-edc7502301de None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.757062 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a4c-3ab9-450a-ae0a-edc7502301de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.760031 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0de2f-c198-4f92-bb05-67359e5d871b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.760527 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0de2f-c198-4f92-bb05-67359e5d871b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.760629 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0de2f-c198-4f92-bb05-67359e5d871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.779666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0df0de2f-c198-4f92-bb05-67359e5d871b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:00.780471 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-218f8a4c-3ab9-450a-ae0a-edc7502301de None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:00.780914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0df0de2f-c198-4f92-bb05-67359e5d871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:00.781799 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-218f8a4c-3ab9-450a-ae0a-edc7502301de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:00.789174 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 569/1157] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:00.790238 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 589/1158] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:00.798674 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.798967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.799121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.799307 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.799414 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.799703 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.817920 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:00.819148 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:00.819285 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:00.820387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:00.829172 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 570/1159] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:00.830064 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 590/1160] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:00.834275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:00.835236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:00.843454 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9617-5699-44b0-8b6e-73d81fdb27af None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:00.846973 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff74bb-6db3-4dd7-ad6c-5e38b5fa84a4 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:00.848544 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:00.849192 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.849468 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.849741 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.850489 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:58:00.850617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:00.850791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:00.851171 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.851462 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.851733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.851851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 16:58:00.851851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:58:00.851851 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:58:00.852577 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:58:00.852704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:00.852887 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:00.854715 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:00.864409 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 571/1161] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 12 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:58:00.870289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 591/1162] 10.222.0.44 () {58 vars in 1152 bytes} [Thu May 12 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:58:00.874367 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:00.874789 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:00.885579 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175da43-fe98-4b11-a520-3cf5469d1d6e admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:00.885800 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1d523-92e9-48fd-8bd5-4e1d42b2fee6 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:00.890594 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:00.890787 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:00.891243 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.891522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.891794 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.892087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.892407 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.892513 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:00.892683 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.893999 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:00.895045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:58:00.895045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:58:00.895045 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:58:00.895310 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:00.896213 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:00.996300 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 572/1163] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:58:01.000457 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.026514 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 592/1164] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:58:01.031428 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.063146 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ea1a-b96f-4196-b70a-f1c97035f8e1 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.094181 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c80ec-71e1-4022-93be-ecec01fc7e74 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.099287 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.099963 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.100249 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.100525 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.101237 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.103352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.120092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 16:58:01.128343 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 16:58:01.129120 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.224394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 593/1165] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 12 16:58:01 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:58:01.228455 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.239132 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb3be-deac-4c9e-b9ec-b52cf67a9352 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.243852 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.244503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.245053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.245384 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.246097 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.247728 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.260301 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 594/1166] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 16:58:01.262760 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 573/1167] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:58:01.265878 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.266244 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.278231 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0375e6-a2a2-485c-add1-6181cabb5dc2 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.278453 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433e440-60e6-4175-a465-e66f3c94195f admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.283169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.283864 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.284032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.284184 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.284406 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.284612 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.284896 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.285157 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.285280 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.285883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.286796 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.287523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.297202 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 574/1168] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:58:01.301716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 595/1169] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:58:01.301988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.303402 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.312812 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d034-0f7e-47b9-ab56-03b711cb3ddb admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.312974 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed953ed-5058-45a7-97b7-1a70a0d0a442 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.318130 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.318592 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.318823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.319108 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.319392 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.319617 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.319899 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.320111 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.320217 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] PATH_INFO: `/v3/projects/3660f292a7914dae803910dd41daf66f/users/19e40b45f4a1489fa07616468defd44e/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.321704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.332260 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 575/1170] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:58:01.335327 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3660f292a7914dae803910dd41daf66f, user_id=19e40b45f4a1489fa07616468defd44e, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.336364 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.336513 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:58:01.336513 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 16:58:01.336513 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 16:58:01.338383 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbeeb-f569-4369-ac4e-dd2e33585737 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.346181 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffba37-b0d2-4e00-82e5-c708e81b3bc7 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.351287 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.354328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.354328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.354328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] PATH_INFO: `/v3/projects/1da4a98233894b71a6eed51650c55b65/users/dcb1cc8a46174e6ab21e54c5e97a6640/roles/c9f667508a63410faf255ae6b67c8ffd` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.370100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da4a98233894b71a6eed51650c55b65, user_id=dcb1cc8a46174e6ab21e54c5e97a6640, role_id=c9f667508a63410faf255ae6b67c8ffd)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.373736 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b89a8-abb0-4d74-99f4-6775205c20bd admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.463516 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 596/1171] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:01 2022] PUT /identity/v3/projects/3660f292a7914dae803910dd41daf66f/users/19e40b45f4a1489fa07616468defd44e/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:58:01.468673 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.468960 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.469234 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.487969 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:01.489387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:01.495312 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 576/1172] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:01 2022] PUT /identity/v3/projects/1da4a98233894b71a6eed51650c55b65/users/dcb1cc8a46174e6ab21e54c5e97a6640/roles/c9f667508a63410faf255ae6b67c8ffd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:58:01.500364 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.500650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.500926 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.519402 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] MFA Rules not processed for user `a20d203a05264464867ecc638e322e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:01.520648 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:01.549276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 597/1173] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:01.559983 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.579933 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 577/1174] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:01.589337 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:01.613317 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536919f5-b102-47d9-8874-8eb8ae54acdd None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.616956 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.617601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.617885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.618164 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.627231 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.629023 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b4f51-c00a-4c03-9c9a-726e827c11df service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.638885 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 598/1175] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:58:01.641549 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63476f-97aa-4348-a7bd-8388b9951c6b None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:01.645388 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:01.646040 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:01.646346 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:01.646625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:01.656061 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:01.657486 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:01.667663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 578/1176] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:58:08.675974 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2913-1b56-4403-ba07-75a558d15cd1 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.676487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2913-1b56-4403-ba07-75a558d15cd1 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.676589 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2913-1b56-4403-ba07-75a558d15cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.722333 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-3b5a2913-1b56-4403-ba07-75a558d15cd1 None None] MFA Rules not processed for user `dcb1cc8a46174e6ab21e54c5e97a6640`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:08.724039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-3b5a2913-1b56-4403-ba07-75a558d15cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:08.831116 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 599/1177] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:08 2022] POST /identity/v3/auth/tokens => generated 2808 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:08.835285 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:08.848974 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc42dc-3fb0-427b-8d11-831b27b31fc8 service neutron] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:08.853849 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:08.854811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.854811 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.855165 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] PATH_INFO: `/v3/projects` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.856062 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:08.858419 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:08.976883 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.977267 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.977459 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.981202 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 579/1178] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 12 16:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:58:08.993298 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.015687 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] MFA Rules not processed for user `19e40b45f4a1489fa07616468defd44e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:09.017051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:09.069877 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f8cdb-8020-4bf0-be0c-4a8a36714149 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.077109 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.077889 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.078049 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.078380 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] PATH_INFO: `/v3/users` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.079083 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.081625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.107566 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 600/1179] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:08 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:09.112187 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.123560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2cfe3-fc85-4a72-b286-9c66eb3b95c5 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.129298 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.129967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.130394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.130654 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.131354 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.133277 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.192463 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 580/1180] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 12 16:58:08 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:58:09.196636 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.209868 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a485b-8e9a-47fc-81fe-948dbb87fdff admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.217448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.219132 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.219417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.219776 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 601/1181] 10.222.0.44 () {60 vars in 1152 bytes} [Thu May 12 16:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:58:09.220162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.221021 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.223261 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.224283 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.239717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 581/1182] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:58:09.243770 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.255012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6400705-0155-478d-9a6d-9e79ce0d3bcb admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.312970 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bb06c-ed0d-475b-8688-44761bfc3b81 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.318484 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.319158 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.319435 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.319765 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.320387 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.321268 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.322208 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.322346 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.322517 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.322788 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] PATH_INFO: `/v3/projects/719d020c60254028a912413947cd9e9c/users/23355d277c2b44d3a4b023556ed4323e/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.342420 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719d020c60254028a912413947cd9e9c, user_id=23355d277c2b44d3a4b023556ed4323e, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.342893 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.444016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 602/1183] 10.222.0.44 () {60 vars in 1143 bytes} [Thu May 12 16:58:09 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:58:09.444016 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.451030 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718225-f118-4494-a719-72f9e65f31a8 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.460067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.462646 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.463039 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.472725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.472725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.472725 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.473171 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 582/1184] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:09 2022] PUT /identity/v3/projects/719d020c60254028a912413947cd9e9c/users/23355d277c2b44d3a4b023556ed4323e/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:58:09.475451 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.480596 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 603/1185] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 16:58:09.484775 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.496986 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bae1b-ad45-4961-93f0-06210c16e3bf admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.555217 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712066c-2264-4b37-809d-e7f1ca02a9e0 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.562717 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.563418 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.563707 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.563988 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.565450 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.567393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.568054 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.569321 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.569598 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.569882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] PATH_INFO: `/v3/projects/044f164709d64410bdb2be06f7e9c069/users/42a5b381fb374abb835bb8b1bdfd8e35/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.582451 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 583/1186] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 16:58:09.585539 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.589539 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=044f164709d64410bdb2be06f7e9c069, user_id=42a5b381fb374abb835bb8b1bdfd8e35, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.592463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.595781 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513333-91ea-4afa-898e-166f9eb35814 admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.601342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.602271 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] REQUEST_METHOD: `PUT` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.604972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.604972 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] PATH_INFO: `/v3/projects/719d020c60254028a912413947cd9e9c/users/23355d277c2b44d3a4b023556ed4323e/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.605183 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=719d020c60254028a912413947cd9e9c, user_id=23355d277c2b44d3a4b023556ed4323e, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.607803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.620413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 584/1187] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:09 2022] PUT /identity/v3/projects/719d020c60254028a912413947cd9e9c/users/23355d277c2b44d3a4b023556ed4323e/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:58:09.670053 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 604/1188] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:09 2022] PUT /identity/v3/projects/044f164709d64410bdb2be06f7e9c069/users/42a5b381fb374abb835bb8b1bdfd8e35/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:58:09.674807 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.747530 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b6040-8311-4b69-9716-b9fad4c8fe2e admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.825883 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.826663 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.826954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.827400 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] PATH_INFO: `/v3/roles` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.828110 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.829779 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354cf93-f61f-4909-9e99-5564ec64c102 admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.843803 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 585/1189] 10.222.0.44 () {58 vars in 1121 bytes} [Thu May 12 16:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:58:09.844894 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:09.856609 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3d881-9ba6-421e-b0b5-baab6662a34b admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:09.863300 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:09.864555 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:09.865082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:09.865551 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] PATH_INFO: `/v3/projects/044f164709d64410bdb2be06f7e9c069/users/42a5b381fb374abb835bb8b1bdfd8e35/roles/5067df1fd41e4852bda05f53294ab802` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:09.868046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=044f164709d64410bdb2be06f7e9c069, user_id=42a5b381fb374abb835bb8b1bdfd8e35, role_id=5067df1fd41e4852bda05f53294ab802)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:09.871343 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:09.888821 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 605/1190] 10.222.0.44 () {60 vars in 1482 bytes} [Thu May 12 16:58:09 2022] PUT /identity/v3/projects/044f164709d64410bdb2be06f7e9c069/users/42a5b381fb374abb835bb8b1bdfd8e35/roles/5067df1fd41e4852bda05f53294ab802 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:58:17.742328 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e00b2f-8cf6-4d14-abe1-ce0a8520b496 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:17.742867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e00b2f-8cf6-4d14-abe1-ce0a8520b496 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:17.742867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e00b2f-8cf6-4d14-abe1-ce0a8520b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:17.779465 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-93e00b2f-8cf6-4d14-abe1-ce0a8520b496 None None] MFA Rules not processed for user `42a5b381fb374abb835bb8b1bdfd8e35`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:17.781303 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-93e00b2f-8cf6-4d14-abe1-ce0a8520b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:17.866160 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 586/1191] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:17 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:17.886937 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:17.889100 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:18.015979 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d6ac-383d-4e5d-9095-c593a6e9bc0e admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:18.021330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530a81ba35704a64a07d373ef18b4ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:18.022483 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:18.023004 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:18.023508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:18.101229 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:18.103772 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:18.113469 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 606/1192] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:17 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:18.212385 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fdbf-93af-4808-a1b9-133c2c317258 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:18.212792 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fdbf-93af-4808-a1b9-133c2c317258 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:18.214567 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fdbf-93af-4808-a1b9-133c2c317258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:18.247076 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-4c39fdbf-93af-4808-a1b9-133c2c317258 None None] MFA Rules not processed for user `23355d277c2b44d3a4b023556ed4323e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:18.248279 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-4c39fdbf-93af-4808-a1b9-133c2c317258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:18.326907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 587/1193] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:18 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:18.341348 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:18.343330 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:18.370781 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4644f-a34e-4372-aa99-5d852d8f3218 service glance] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:18.375563 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530a81ba35704a64a07d373ef18b4ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:18.376167 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:18.376452 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:18.376733 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:18.461279 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:18.462826 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eb06a-ba1c-443d-81d6-611bc8412c97 service glance] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:18.479928 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 607/1194] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:18 2022] GET /identity/v3/auth/tokens => generated 2808 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:58:28.874488 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e3d-5d64-4844-b008-ca2ba4bda899 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:28.875057 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e3d-5d64-4844-b008-ca2ba4bda899 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:28.875152 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e3d-5d64-4844-b008-ca2ba4bda899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:28.900020 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d7df1e3d-5d64-4844-b008-ca2ba4bda899 None None] MFA Rules not processed for user `dcb1cc8a46174e6ab21e54c5e97a6640`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:28.903592 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d7df1e3d-5d64-4844-b008-ca2ba4bda899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:28.908703 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 588/1195] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 16:58:28 2022] POST /identity/v3/auth/tokens => generated 2808 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:29.192571 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5e61-4cb5-4c3f-b809-3cec1e37d1ff None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.193110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5e61-4cb5-4c3f-b809-3cec1e37d1ff None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.193222 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5e61-4cb5-4c3f-b809-3cec1e37d1ff None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.194543 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 608/1196] 10.222.0.44 () {54 vars in 961 bytes} [Thu May 12 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:29.199782 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d7c-fbed-436e-8144-8b8dff96622b None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.200075 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d7c-fbed-436e-8144-8b8dff96622b None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.200545 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d7c-fbed-436e-8144-8b8dff96622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.218471 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-0b617d7c-fbed-436e-8144-8b8dff96622b None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:29.219683 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-0b617d7c-fbed-436e-8144-8b8dff96622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:29.285940 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 589/1197] 10.222.0.44 () {58 vars in 1058 bytes} [Thu May 12 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:29.291142 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03121-0775-43b0-9c5f-28961c843d18 None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.291437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03121-0775-43b0-9c5f-28961c843d18 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.291719 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c03121-0775-43b0-9c5f-28961c843d18 None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.293055 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 609/1198] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 12 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:29.297954 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a6f0-8a22-4ca2-a4c5-f8769e1e486f None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.302297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a6f0-8a22-4ca2-a4c5-f8769e1e486f None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.302297 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a6f0-8a22-4ca2-a4c5-f8769e1e486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.317134 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-a928a6f0-8a22-4ca2-a4c5-f8769e1e486f None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:29.318394 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-a928a6f0-8a22-4ca2-a4c5-f8769e1e486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:29.327412 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 590/1199] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 12 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:29.339276 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03121-0775-43b0-9c5f-28961c843d18 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:29.350263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c03121-0775-43b0-9c5f-28961c843d18 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:29.353853 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530a81ba35704a64a07d373ef18b4ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:29.354560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.354850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.355311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.365838 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:29.367313 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e8d97-dce0-4d57-a71f-e2534285fce6 service glance] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:29.378263 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 610/1200] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:29.733052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673ffc-52a1-44cf-9387-856a56aab632 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.741149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673ffc-52a1-44cf-9387-856a56aab632 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.741149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673ffc-52a1-44cf-9387-856a56aab632 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.741149 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 591/1201] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 12 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:29.741423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cb97-80b8-4b1a-b201-671714710f6e None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.741423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cb97-80b8-4b1a-b201-671714710f6e None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.741423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cb97-80b8-4b1a-b201-671714710f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.760753 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-4673cb97-80b8-4b1a-b201-671714710f6e None None] MFA Rules not processed for user `defbe1cd07004860a20a4370f03ff612`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:29.761967 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4673cb97-80b8-4b1a-b201-671714710f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:29.816194 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 611/1202] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 12 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:29.827474 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f673ffc-52a1-44cf-9387-856a56aab632 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:29.838427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f673ffc-52a1-44cf-9387-856a56aab632 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:29.842072 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:29.842910 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.843387 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.843666 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.851581 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:29.853103 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd6600-98ac-4aeb-b59c-0f595437a61d service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:29.862052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 592/1203] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:29 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:30.410175 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15d02-44a3-4d79-a8de-1ebe5b9afe7a None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.417463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15d02-44a3-4d79-a8de-1ebe5b9afe7a None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.417463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15d02-44a3-4d79-a8de-1ebe5b9afe7a None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.417463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 612/1204] 10.222.0.44 () {54 vars in 961 bytes} [Thu May 12 16:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:30.419522 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833008-18c2-406a-b1e2-59ef28c05c62 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.420000 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833008-18c2-406a-b1e2-59ef28c05c62 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.420095 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833008-18c2-406a-b1e2-59ef28c05c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.433234 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cafca-6ce8-4cad-95ea-63995995ec5d None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.433641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cafca-6ce8-4cad-95ea-63995995ec5d None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.434032 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cafca-6ce8-4cad-95ea-63995995ec5d None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.435945 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 613/1205] 10.222.0.44 () {54 vars in 960 bytes} [Thu May 12 16:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:58:30.441061 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.444921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.445067 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-fb833008-18c2-406a-b1e2-59ef28c05c62 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:30.445210 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.445317 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-fb833008-18c2-406a-b1e2-59ef28c05c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:30.453813 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 593/1206] 10.222.0.44 () {58 vars in 1058 bytes} [Thu May 12 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:30.460540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee95e1-1e69-443c-8741-3f0367a99df9 None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.460838 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee95e1-1e69-443c-8741-3f0367a99df9 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.461113 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee95e1-1e69-443c-8741-3f0367a99df9 None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.461701 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] MFA Rules not processed for user `12fdfcd0ace142d49be44ff2772425f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:30.464804 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:30.466361 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 594/1207] 10.222.0.44 () {54 vars in 912 bytes} [Thu May 12 16:58:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:58:30.469329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.469329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.469329 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.495704 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:30.496921 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:30.508521 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 595/1208] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 12 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:30.523715 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:30.543867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ab5c-0600-47d2-a540-e81328d8df63 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:30.543867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:30.543867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.543867 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.544249 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.549355 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:30.550915 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004ed2-da15-4702-8875-b7d9fa8d8f54 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:30.558380 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 614/1209] 10.222.0.44 () {58 vars in 1057 bytes} [Thu May 12 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:30.560082 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:30.568074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 596/1210] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:58:30.571816 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b1252-cdae-4d55-823c-b995ee5ed1c4 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:30.577110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12fdfcd0ace142d49be44ff2772425f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:30.577758 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.578046 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.578593 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.580976 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:30.593530 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:30.595115 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:30.606689 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 615/1211] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:42.225046 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47809-76cd-45d9-891d-fd8d8d134382 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:42.226540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47809-76cd-45d9-891d-fd8d8d134382 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:42.226540 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47809-76cd-45d9-891d-fd8d8d134382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:42.250246 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-91d47809-76cd-45d9-891d-fd8d8d134382 None None] MFA Rules not processed for user `defbe1cd07004860a20a4370f03ff612`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:42.251455 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-91d47809-76cd-45d9-891d-fd8d8d134382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:42.258275 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 597/1212] 10.222.0.25 () {58 vars in 1015 bytes} [Thu May 12 16:58:42 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:42.271067 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:42.281005 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59576-8cba-4784-9960-23b0a2a92d08 service placement] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:42.285352 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:42.294858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:42.294858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:42.294858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:42.294858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:42.295247 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82484bd2-6e9f-4c2e-9d8a-3fcf963f7fc7 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:42.306278 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 616/1213] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:42 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:43.481495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213913-4aed-437c-bd2a-e349e238ae3a None None] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.482116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213913-4aed-437c-bd2a-e349e238ae3a None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.482116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213913-4aed-437c-bd2a-e349e238ae3a None None] PATH_INFO: `/` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.483395 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 598/1214] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 16:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:43.489664 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e532f3-0752-4ca6-8307-fba6f54ec0e8 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.490236 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e532f3-0752-4ca6-8307-fba6f54ec0e8 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.490337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e532f3-0752-4ca6-8307-fba6f54ec0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.514360 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-b4e532f3-0752-4ca6-8307-fba6f54ec0e8 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:43.516188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-b4e532f3-0752-4ca6-8307-fba6f54ec0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:43.529503 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 617/1215] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 16:58:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:43.544376 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a213913-4aed-437c-bd2a-e349e238ae3a None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:43.562234 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a213913-4aed-437c-bd2a-e349e238ae3a None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:43.569162 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:43.569824 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.570342 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.570460 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.580417 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:43.582311 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75349a-1b3d-4ea1-bdc1-1a4123109ea6 service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:43.597757 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 599/1216] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:43 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:49.800583 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dca1-f8cd-479c-a683-08f38e1612ad None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:49.801220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dca1-f8cd-479c-a683-08f38e1612ad None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:49.801220 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980dca1-f8cd-479c-a683-08f38e1612ad None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:49.803437 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 618/1217] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 16:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:58:49.811590 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:49.814836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:49.814836 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:49.840565 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:49.841869 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:49.851985 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 600/1218] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 16:58:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:49.864794 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980dca1-f8cd-479c-a683-08f38e1612ad None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:49.884882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980dca1-f8cd-479c-a683-08f38e1612ad None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:49.894090 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:49.895286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:49.895792 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:49.896289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:49.913475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:49.916612 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330be29-5ff6-429d-ad47-5593aa3f2b2e service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:49.933526 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 619/1219] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:58:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:05.352566 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:05.365743 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d5d9-12aa-404d-a087-6bde114b29a5 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:05.372187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:05.372187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:05.372187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:05.372187 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:05.381855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:05.383479 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a4e34-1ec9-4ec8-946e-56ef8bc91beb service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:05.396218 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 601/1220] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 16:59:05 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:00:14.992828 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9fa-cb18-4ac2-a5ec-5a2bcfd6f77f None None] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:14.993438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9fa-cb18-4ac2-a5ec-5a2bcfd6f77f None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:14.993438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d9fa-cb18-4ac2-a5ec-5a2bcfd6f77f None None] PATH_INFO: `/` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:14.994766 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 620/1221] 10.222.0.44 () {54 vars in 921 bytes} [Thu May 12 17:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:00:15.003478 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3556db-e665-436c-8782-97e6e745a297 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:15.004403 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3556db-e665-436c-8782-97e6e745a297 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:15.004686 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3556db-e665-436c-8782-97e6e745a297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:15.073676 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-7a3556db-e665-436c-8782-97e6e745a297 None None] MFA Rules not processed for user `32e2241ed2ff4f1e935b69e21838908b`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:00:15.075012 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-7a3556db-e665-436c-8782-97e6e745a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:00:15.132858 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 602/1222] 10.222.0.44 () {58 vars in 1018 bytes} [Thu May 12 17:00:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:00:15.145850 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d9fa-cb18-4ac2-a5ec-5a2bcfd6f77f None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:15.160015 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d9fa-cb18-4ac2-a5ec-5a2bcfd6f77f None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:15.165648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:15.166316 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:15.166601 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:15.167013 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:15.176551 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:15.178337 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d2e67-daaa-4dcf-8084-8f3ff822139e service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:15.189311 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 621/1223] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:00:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:00:30.195826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:30.196281 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:30.196378 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:30.214227 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] MFA Rules not processed for user `19e40b45f4a1489fa07616468defd44e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:00:30.215501 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:00:30.222635 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 603/1224] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 17:00:30 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:00:30.946057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:30.946629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:30.946629 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:30.997463 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] MFA Rules not processed for user `defbe1cd07004860a20a4370f03ff612`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:00:30.998722 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:00:31.014858 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 622/1225] 10.222.0.44 () {58 vars in 1009 bytes} [Thu May 12 17:00:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:00:31.030783 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:31.042421 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b5609-0002-409b-8f03-5c16150982a7 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:31.046024 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:31.046707 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:31.047088 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:31.047247 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:31.055840 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:31.057273 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:31.065510 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 604/1226] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:00:31 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:00:40.211014 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:40.316923 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef810eaf-28a8-47e4-8194-45edc1c8e528 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:40.322545 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:40.323498 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:40.323775 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:40.324071 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] PATH_INFO: `/v3/users/dcb1cc8a46174e6ab21e54c5e97a6640` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:40.325286 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb1cc8a46174e6ab21e54c5e97a6640)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:40.326353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: WARNING py.warnings [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:00:40.326353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: warnings.warn(msg) May 12 17:00:40.326353 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: May 12 17:00:40.327576 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:40.636527 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb1cc8a46174e6ab21e54c5e97a6640'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:40.639645 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb1cc8a46174e6ab21e54c5e97a6640'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:40.654538 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb1cc8a46174e6ab21e54c5e97a6640'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:40.655235 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb1cc8a46174e6ab21e54c5e97a6640'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:40.675239 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb1cc8a46174e6ab21e54c5e97a6640'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:40.736133 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 623/1227] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 12 17:00:40 2022] DELETE /identity/v3/users/dcb1cc8a46174e6ab21e54c5e97a6640 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:00:40.999929 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:41.014515 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dc5e1-3743-4e9f-a7b6-87105dad8187 service neutron] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:41.073145 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:41.073995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:41.074305 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:41.074583 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] PATH_INFO: `/v3/projects/1da4a98233894b71a6eed51650c55b65` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:41.075762 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da4a98233894b71a6eed51650c55b65)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:41.076774 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: WARNING py.warnings [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:00:41.076774 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: warnings.warn(msg) May 12 17:00:41.076774 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: May 12 17:00:41.077969 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:41.191763 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da4a98233894b71a6eed51650c55b65', 'request_id': 'req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.198538 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da4a98233894b71a6eed51650c55b65', 'request_id': 'req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.272873 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da4a98233894b71a6eed51650c55b65', 'request_id': 'req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.305995 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] The token cache is being invalidate because project 1da4a98233894b71a6eed51650c55b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:00:41.306314 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.307338 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.309129 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 605/1228] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 12 17:00:40 2022] DELETE /identity/v3/projects/1da4a98233894b71a6eed51650c55b65 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:00:41.314849 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:41.316560 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:00:41.331063 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d0a7c-cf1d-45b1-ac4f-744e5b8cb10c admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:41.387475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:41.388445 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:41.388721 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:41.388990 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] PATH_INFO: `/v3/users/23355d277c2b44d3a4b023556ed4323e` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:41.390458 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23355d277c2b44d3a4b023556ed4323e)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:41.392475 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:41.631656 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23355d277c2b44d3a4b023556ed4323e'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.635968 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23355d277c2b44d3a4b023556ed4323e'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.639509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23355d277c2b44d3a4b023556ed4323e'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.640173 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23355d277c2b44d3a4b023556ed4323e'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.651751 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-9f21b195-37de-4ead-8ba5-2ee74d08fd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23355d277c2b44d3a4b023556ed4323e'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:41.749292 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 624/1229] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 12 17:00:41 2022] DELETE /identity/v3/users/23355d277c2b44d3a4b023556ed4323e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:00:42.025912 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:00:42.027480 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:00:42.040914 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca772-e3ac-4f66-90bb-7b022f774e2e admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:00:42.098570 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:00:42.099431 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:00:42.099712 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:00:42.100033 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] PATH_INFO: `/v3/projects/719d020c60254028a912413947cd9e9c` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:00:42.101768 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] RBAC: Authorizing `identity:delete_project(project_id=719d020c60254028a912413947cd9e9c)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:00:42.103718 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:00:42.238766 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719d020c60254028a912413947cd9e9c', 'request_id': 'req-c3f921b8-7284-45c9-b678-d7faf8dc439e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:42.244444 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719d020c60254028a912413947cd9e9c', 'request_id': 'req-c3f921b8-7284-45c9-b678-d7faf8dc439e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:42.336724 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719d020c60254028a912413947cd9e9c', 'request_id': 'req-c3f921b8-7284-45c9-b678-d7faf8dc439e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:42.350018 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] The token cache is being invalidate because project 719d020c60254028a912413947cd9e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:00:42.350370 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:42.351156 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-c3f921b8-7284-45c9-b678-d7faf8dc439e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:00:42.352829 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 606/1230] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 12 17:00:42 2022] DELETE /identity/v3/projects/719d020c60254028a912413947cd9e9c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:01:11.224737 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] REQUEST_METHOD: `POST` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:11.225260 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:11.225350 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:11.243880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.auth.core [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] MFA Rules not processed for user `19e40b45f4a1489fa07616468defd44e`. Rule list: `[]` (Enabled: `True`). {{(pid=93661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:11.245211 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:11.299744 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 625/1231] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 17:01:11 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:28.907625 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae91b2-e66b-4555-919d-65564e34307c None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:28.908265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae91b2-e66b-4555-919d-65564e34307c None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:28.908265 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae91b2-e66b-4555-919d-65564e34307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:28.925393 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-e5ae91b2-e66b-4555-919d-65564e34307c None None] MFA Rules not processed for user `19e40b45f4a1489fa07616468defd44e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:28.926645 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-e5ae91b2-e66b-4555-919d-65564e34307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:28.933434 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 607/1232] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 17:01:28 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:30.836988 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:30.842115 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:30.917675 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6f779-1b7a-40d9-88a8-65962fa97171 None None] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:30.922880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12fdfcd0ace142d49be44ff2772425f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:30.923554 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:30.923833 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:30.924127 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:30.925918 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:30.937189 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:30.939398 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:30.949024 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 626/1233] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:01:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:02:53.705461 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] REQUEST_METHOD: `POST` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:53.705958 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:53.706051 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:53.723859 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.auth.core [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] MFA Rules not processed for user `19e40b45f4a1489fa07616468defd44e`. Rule list: `[]` (Enabled: `True`). {{(pid=93662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:02:53.725054 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:53.732721 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 608/1234] 10.222.0.44 () {58 vars in 957 bytes} [Thu May 12 17:02:53 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:08.168495 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:08.169927 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:08.224509 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2bc4-36fb-4e00-afa2-abb405f33cf1 service placement] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:08.228882 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:08.229528 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:08.229810 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:08.230087 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:08.231897 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:08.292159 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:08.293607 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:08.303340 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 627/1235] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:03:08 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:04:25.075332 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:25.076765 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:25.089211 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018121f-bab7-4fbf-9394-2a613bb76989 None None] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:25.092786 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:25.093426 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:25.093707 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:25.093981 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:25.095726 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:25.105903 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:25.107381 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:25.115121 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 609/1236] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:04:25 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:31.692456 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:31.693859 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:31.783611 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d97a-c527-4c11-870f-36bd2544bd30 service neutron] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:31.788666 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:31.790017 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:31.790334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:31.790618 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:31.792423 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:31.802487 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:31.804057 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:31.813394 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 628/1237] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:31 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:33.640942 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:33.656979 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ae3ae-6d07-41a5-b14c-529fb9baac8f service neutron] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:33.663244 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:33.666074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:33.666074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:33.666074 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:33.667711 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:33.682100 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:33.683907 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:33.706429 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 610/1238] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:34.197281 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:34.206572 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4714c-edc6-4d4c-82eb-591283cd0410 service nova] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:34.210139 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:34.210961 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:34.211246 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:34.211523 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:34.213315 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:34.226169 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:34.228575 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:34.238991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 629/1239] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:35.413650 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:35.422855 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf6ed-9f2d-475a-8983-6f627da41a6e service nova] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:35.426413 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:35.427041 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:35.427323 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:35.427598 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:35.429428 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:35.442116 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:35.443576 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:35.454373 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 611/1240] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:37.619438 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:37.620878 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:37.634009 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6788-1c3b-4a44-9a7f-3f54dc561413 service neutron] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:37.639074 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2241ed2ff4f1e935b69e21838908b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:37.639707 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:37.639991 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:37.640270 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:37.641962 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:37.653188 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:37.654807 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:37.664359 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 630/1241] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:38.286169 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:38.298047 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766c2dc-d79d-4a12-8e44-6744bffb6c1d service neutron] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:38.303143 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12fdfcd0ace142d49be44ff2772425f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:38.305791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] REQUEST_METHOD: `GET` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:38.305791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:38.305791 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:38.313375 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:38.314994 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:38.325348 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 612/1242] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:49.002209 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:49.011416 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868e43-fc7f-4580-9137-8160de3a3baa service nova] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:49.015081 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbe1cd07004860a20a4370f03ff612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '872992402bf54bed914e8e79adc26df1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:49.015716 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] REQUEST_METHOD: `GET` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:49.015996 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:49.016272 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:49.018334 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:49.078895 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:49.080329 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:49.089774 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 631/1243] 10.222.0.44 () {60 vars in 1365 bytes} [Thu May 12 17:06:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:56.951987 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:56.953397 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:56.968879 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57970a5-2009-4505-8848-b292b4318f06 service placement] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:56.973495 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:56.974401 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:56.974690 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:56.974971 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] PATH_INFO: `/v3/users/19e40b45f4a1489fa07616468defd44e` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:56.976164 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e40b45f4a1489fa07616468defd44e)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:56.978138 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:57.177448 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e40b45f4a1489fa07616468defd44e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.178073 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e40b45f4a1489fa07616468defd44e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.185177 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e40b45f4a1489fa07616468defd44e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.185793 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e40b45f4a1489fa07616468defd44e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.197427 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e40b45f4a1489fa07616468defd44e'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.267823 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 613/1244] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 12 17:06:56 2022] DELETE /identity/v3/users/19e40b45f4a1489fa07616468defd44e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:06:57.521875 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:57.535351 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0bf8-008f-4635-9066-0b1de787f835 service neutron] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:57.598168 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:57.599041 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:57.599320 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:57.599593 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] PATH_INFO: `/v3/projects/3660f292a7914dae803910dd41daf66f` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:57.600880 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3660f292a7914dae803910dd41daf66f)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:57.602912 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:57.718964 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3660f292a7914dae803910dd41daf66f', 'request_id': 'req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.724118 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3660f292a7914dae803910dd41daf66f', 'request_id': 'req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.811604 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3660f292a7914dae803910dd41daf66f', 'request_id': 'req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.823051 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] The token cache is being invalidate because project 3660f292a7914dae803910dd41daf66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:06:57.823338 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.825588 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:57.826289 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 632/1245] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 12 17:06:57 2022] DELETE /identity/v3/projects/3660f292a7914dae803910dd41daf66f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:06:57.838534 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Authenticating user token {{(pid=93662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:57.840523 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.fernet_utils [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:57.857092 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024127c6-d25c-48f5-8579-a60375e0160b admin admin] Validating token access rules against request {{(pid=93662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:57.915560 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:57.916699 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:57.917071 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] SCRIPT_NAME: `/identity` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:57.917444 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] PATH_INFO: `/v3/users/42a5b381fb374abb835bb8b1bdfd8e35` {{(pid=93662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:57.918826 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a5b381fb374abb835bb8b1bdfd8e35)` {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:57.920843 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] RBAC: Authorization granted {{(pid=93662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:58.105643 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a5b381fb374abb835bb8b1bdfd8e35'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.106371 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a5b381fb374abb835bb8b1bdfd8e35'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.114270 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a5b381fb374abb835bb8b1bdfd8e35'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.115360 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a5b381fb374abb835bb8b1bdfd8e35'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.130052 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: DEBUG keystone.notifications [None req-a7edda4b-f912-44f0-b3f2-cf33510c713f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a5b381fb374abb835bb8b1bdfd8e35'} {{(pid=93662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.206506 dv-osbrick-836059-3-ceph devstack@keystone.service[93662]: [pid: 93662|app: 0|req: 614/1246] 10.222.0.44 () {58 vars in 1223 bytes} [Thu May 12 17:06:57 2022] DELETE /identity/v3/users/42a5b381fb374abb835bb8b1bdfd8e35 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:06:58.500295 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Authenticating user token {{(pid=93661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:58.501890 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.fernet_utils [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:58.517830 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c849d-8d14-466c-b8b0-6a5ebba9f1b8 admin admin] Validating token access rules against request {{(pid=93661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:58.583508 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20d203a05264464867ecc638e322e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '117739cb2486406297165f39ae144b9a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:58.584369 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:58.584648 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:58.584921 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] PATH_INFO: `/v3/projects/044f164709d64410bdb2be06f7e9c069` {{(pid=93661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:58.586110 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044f164709d64410bdb2be06f7e9c069)` {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:58.588079 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] RBAC: Authorization granted {{(pid=93661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:58.715641 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044f164709d64410bdb2be06f7e9c069', 'request_id': 'req-ef9b5767-ecd3-4157-b40b-72d79ce0f867'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.720828 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044f164709d64410bdb2be06f7e9c069', 'request_id': 'req-ef9b5767-ecd3-4157-b40b-72d79ce0f867'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.777754 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044f164709d64410bdb2be06f7e9c069', 'request_id': 'req-ef9b5767-ecd3-4157-b40b-72d79ce0f867'} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.790161 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] The token cache is being invalidate because project 044f164709d64410bdb2be06f7e9c069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:06:58.790500 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.791197 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: DEBUG keystone.notifications [None req-ef9b5767-ecd3-4157-b40b-72d79ce0f867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:06:58.792904 dv-osbrick-836059-3-ceph devstack@keystone.service[93661]: [pid: 93661|app: 0|req: 633/1247] 10.222.0.44 () {58 vars in 1232 bytes} [Thu May 12 17:06:58 2022] DELETE /identity/v3/projects/044f164709d64410bdb2be06f7e9c069 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)